Information processing device, information processing method, and storage medium

Abstract

The present invention detects the attitude of a terminal device which is provided with a camera. A degree of deviation of an attitude from a reference position of a camera with respect to an imaging subject is determined on the basis of the attitude. Information indicating the degree of deviation is outputted in a manner in which the imaging subject can recognize the information.

Description

Information processing device, information processing method, and storage medium

[0001] The present disclosure relates to an information processing device, an information processing method, and a storage medium.

[0002] Patent Document 1 discloses a technology that supports a user in providing an appropriate image for identity verification.

[0003] For example, in paragraphs 0054 to 0055 and FIG. 8 of Patent Document 1, a technique is disclosed regarding a method for determining whether an image input via a camera is a proper image.

[0004] Japanese Patent Application Laid-Open No. 2020-21373

[0005] Even with the above-described techniques, there are cases where the images obtained are not suitable for predetermined processing such as authentication using the facial image of the person being photographed.

[0006] An object of the present disclosure is to provide an information processing device, an information processing method, and a storage medium that solve the above-mentioned problems.

[0007] An information processing device according to one aspect of the present disclosure includes a detection means for detecting the attitude of a terminal device equipped with a camera, a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera relative to a subject to be photographed based on the attitude, and an output means for outputting information indicating the degree of deviation in a manner that can be recognized by the subject to be photographed.

[0008] An information processing device according to one aspect of the present disclosure includes a deviation determination means for determining the degree of deviation from a reference position in the vertical direction and the degree of deviation from a reference position in the horizontal direction when the subject appears in an image acquired from a camera by photographing the subject and is displayed on a display, a quality acquisition means for acquiring a quality level of the subject, and an output means for outputting information indicating the degree of deviation and information indicating the quality level in a manner that can be recognized by the subject.

[0009] An information processing method according to one aspect of the present disclosure detects the attitude of a terminal device equipped with a camera, determines the degree of deviation of the attitude from a reference position of the camera relative to a subject to be photographed based on the attitude, and outputs information indicating the degree of deviation in a manner that is recognizable by the subject to be photographed.

[0010] A storage medium according to one aspect of the present disclosure stores a program that causes a computer of an information processing device to function as a detection means for detecting the attitude of a terminal device equipped with a camera, a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera relative to a subject to be photographed based on the attitude, and an output means for outputting information indicating the degree of deviation in a manner that can be recognized by the subject to be photographed.

[0011] 1 is a diagram illustrating an example of an information processing device according to an embodiment of the present disclosure; FIG. 2 is a diagram illustrating a coordinate system of a terminal device according to an embodiment of the present disclosure; FIG. 3 is a diagram illustrating a hardware configuration of a terminal device according to an embodiment of the present disclosure; FIG. 4 is a functional block diagram of a terminal device according to an embodiment of the present disclosure; FIG. 5 is a diagram illustrating an example display in a terminal device according to an embodiment of the present disclosure; FIG. 6 is a diagram illustrating a processing flow by a terminal device according to an embodiment of the present disclosure; FIG. 7 is a diagram illustrating an example of another information processing system according to the present disclosure; FIG. 8 is a first diagram illustrating functional blocks of another information processing device according to the present disclosure; FIG. 9 is a first diagram illustrating a processing flow of another information processing device according to the present disclosure; FIG. 10 is a second diagram illustrating functional blocks of another information processing device according to the present disclosure; FIG. 11 is a second diagram illustrating a processing flow of another information processing device according to the present disclosure; FIG. 12 is a third diagram illustrating functional blocks of another information processing device according to the present disclosure; FIG. 13 is a third diagram illustrating a processing flow of another information processing device according to the present disclosure; FIG. 14 is a fourth diagram illustrating functional blocks of another information processing device according to the present disclosure;

[0012] Hereinafter, the information processing device of the present disclosure will be described with reference to the drawings.

[0013] FIG. 1 is a diagram illustrating an example of an information processing device according to an embodiment of the present disclosure. The terminal device 1 is an example of an information processing device that can be carried by a user, such as a smartphone or a tablet terminal. The user uses the terminal device 1 to take a picture of their own face. The terminal device 1 generates a facial image that shows the user's face. The facial image may be used for predetermined processing such as authentication in the terminal device 1 or a cloud server to which the terminal device 1 is connected for communication. The terminal device 1 or the cloud server may simply store and process the facial image.

[0014] FIG. 2 is a diagram illustrating a coordinate system of a terminal device according to an embodiment of the present disclosure. The terminal device 1 may be capable of detecting angles around at least the first and third axes among a first axis (y-axis), a second axis (z-axis), and a third axis (x-axis). The first axis corresponds to the shooting direction of the camera 2 capturing the user, who is the subject of the image capture, and corresponds to the normal to the plane of the display 3 of the terminal device 1 equipped with the camera 2. The second axis corresponds to the vertical direction of the plane of the display 3, which is perpendicular to the first axis. The third axis corresponds to the vertical axis of the first and second axes, and corresponds to the horizontal axis of the plane of the display 3. As an example, a user holds the terminal device 1 so that the second axis (z-axis) is perpendicular to the vertical direction, and points the first axis (y-axis) toward their face to capture an image of their face.

[0015] The terminal device 1 detects whether the second axis (z-axis) is perpendicular to the vertical direction based on the angle around the third axis (x-axis). The terminal device 1 detects whether the second axis (z-axis) of the camera 2 is facing vertically based on the angle around the first axis (y-axis). To detect the angles around these axes, the terminal device 1 is equipped with a sensor. The sensor may be equipped with a three-axis accelerometer for the first, second, and third axes, a three-axis gyroscope, or may further have a azimuth sensor function. To detect angles around each axis, such as the angle around the third axis (x-axis) or the angle around the first axis (y-axis), the angle detection function of the terminal device 1 may use known technology.

[0016] 3 is a hardware configuration diagram of a terminal device according to an embodiment of the present disclosure. As shown in FIG. 3, the terminal device 1 is a computer including various pieces of hardware such as a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage device 104, a communication module 105, and a sensor 106. The sensor 106 may output numerical values ​​of angles around each of the above-mentioned axes.

[0017] 4 is a functional block diagram of a terminal device according to an embodiment of the present disclosure. A CPU 101 of the terminal device 1 starts an imaging program. As a result, the terminal device 1 performs functions such as a control unit 11, an acquisition unit 12, a deviation determination unit 13, a quality determination unit 14, a size determination unit 15, a storage unit 16, a display unit 17, an audio output unit 18, and a UI (User Interface) unit 19.

[0018] The control unit 11 controls the information processing of the terminal device 1 according to the present disclosure. The acquisition unit 12 acquires various information. The deviation determination unit 13 determines the degree of deviation, which indicates whether the plane of the display 3 is vertical based on rotation about the third axis (x-axis), and the degree of deviation, which indicates whether the up-down direction of the user's face, the subject of the image, matches the up-down direction of the display based on rotation about the first axis (y-axis). The deviation determination unit 13 may determine the deviation of the position of the user's face in the face image captured by the terminal device 1 through other processing. The quality determination unit 14 acquires the quality degree of the subject of the image. The quality degree indicates the degree to which the face image is determined to have a predetermined quality, such as whether the brightness of the face is within a predetermined threshold, whether it is backlit, and whether the eyes are closed.

[0019] The size determination unit 15 determines the degree of agreement between the size that the face area of ​​the subject should be in the photographed image displayed on the display 3 and the size of the face area of ​​the subject in the photographed image actually displayed on the display.

[0020] The storage unit 16 stores the captured image when the degree of deviation is equal to or less than a threshold, the degree of size coincidence is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold. The display unit 17 displays the captured image on the display 3. The audio output unit 18 may output audio guidance or the like. The UI unit 19 controls the user interface displayed on the terminal device 1.

[0021] 5 is a diagram illustrating an example of a display on a terminal device according to an embodiment of the present disclosure. In a main aspect of the present disclosure, the terminal device 1 first determines the degree of each of the deviations indicating whether the plane of the display based on rotation about the third axis (x) is vertical or not, and the deviation indicating whether the up-down direction of the subject to be photographed and the up-down direction of the display based on rotation about the first axis (y) are aligned, and outputs information D1 indicating the degree of deviation (step S1).

[0022] The terminal device 1 also determines the degree of coincidence between the size of the face area in the photographed image displayed on the display 3 that should be present and the size of the face area in the photographed image that is actually displayed on the display, and outputs information D2 that allows the degree of coincidence to be recognized (step S2).The terminal device 1 also outputs information D3 that indicates the degree of quality of the photographed face image (step S3).

[0023] 6 is a diagram showing a processing flow by the terminal device according to an embodiment of the present disclosure. Next, the processing flow of the terminal device 1 will be described step by step.

[0024] The user instructs the terminal device 1 to start capturing an image. The UI unit 19 outputs the start instruction to the control unit 11. The control unit 11 instructs the deviation determination unit 13 and the display unit 17 to start processing. The deviation determination unit 13 acquires a rotation angle α1 of the third axis (x) from a reference position when the second axis (z axis) is in the vertical direction and the display 3 is vertical, which is the reference position. The deviation determination unit 13 also acquires a rotation angle α2 of the second axis (y axis) when the second axis is in the vertical direction and the display 3 is vertical, which is the reference position. The deviation determination unit 13 outputs the rotation angles α1 and α2 to the display unit 17.

[0025] As an example, the rotation angle α1 may indicate a negative value when the upper part of the terminal device 1 (near the location where the camera 2 is attached in FIG. 2) is tilted toward the shooting direction. Conversely, the rotation angle α1 may indicate a positive value when the upper part of the terminal device 1 is tilted in the opposite direction to the shooting direction.

[0026] As another example, the rotation angle α2 may indicate a negative value when the terminal device 1 is rotating to the right (left as seen from the user) around the first axis (y-axis). Conversely, the rotation angle α2 may indicate a negative value when the terminal device 1 is rotating to the left (right as seen from the user) around the first axis (y-axis). The deviation determination unit 13 outputs the rotation angles α1 and α2 to the display unit 7. The deviation determination unit 13 outputs the rotation angles α1 and α2 to the display unit 7 at short intervals, such as 1 ms (millisecond).

[0027] While the deviation determination unit 13 of the terminal device 1 is performing processing, for example, the display unit 17 stops displaying on the display 3 the facial image of the user being photographed, acquired via the camera 2. By stopping the display of the user's facial image on the display 3, the user can hold the terminal device 1 and concentrate on practicing the orientation of the terminal device 1 when capturing a high-quality facial image of the user. While the display of the facial image on the display 3 is stopped, the display unit 17 outputs information D1 indicating the degree of deviation to the display 3 (step S101). This processing is an example of processing that acquires the value of the tilt sensor of the terminal device 1, displays a guide (information D1) according to the sensor value, and prompts the user to hold the terminal device 1 (smartphone, etc.) vertically.

[0028] As shown in information D1 in FIG. 5 , the display unit 17 outputs information D1 representing the fixed frame w11 and the moving frame w12. The fixed frame w11 indicates a reference position for the attitude of the terminal device 1. The position of the moving frame w12 fluctuates depending on the rotation angles α1 and α2. When the rotation angles α1 and α2 are close to 0 and coincide with their respective reference positions, the display unit 17 displays the position of the moving frame w12 at the position of the fixed frame w11. As the value of the rotation angle α1 increases in the negative direction, the display unit 17 sequentially moves and displays the moving frame w12 to a position below the fixed frame w11 on the display 3. As the value of the rotation angle α1 increases in the positive direction, the display unit 17 sequentially moves and displays the moving frame w12 to a position above the fixed frame w11 on the display 3. As the value of the rotation angle α2 increases in the negative direction, the display unit 17 sequentially moves and displays the moving frame w12 to a position to the left of the fixed frame w11 on the display 3 as seen from the user. As the value of the rotation angle α2 increases in the positive direction, the display unit 17 sequentially moves and displays the moving frame w12 to a position to the right of the fixed frame w11 as seen from the user on the display 3. By displaying the information D1 in this manner, the user can recognize for themselves whether the orientation of the terminal device 1, based on the state in which the terminal device 1 is upright, is appropriate for photographing the user.

[0029] The user practices changing the attitude of the terminal device 1 so that the moving frame w12 coincides with the position of the fixed frame w11. When the moving frame w12 coincides with the fixed frame w11, the attitude of the terminal device 1 is such that the surface of the display 3 is vertical, and the up-down direction of the user's face coincides with the up-down direction of the terminal device 1. This allows the user to appropriately and easily adjust the attitude of the terminal device 1 while checking the information D1 indicating the degree of misalignment.

[0030] In this embodiment, the terminal device 1 moves and displays the position of the moving frame w12 relative to the fixed frame w11 based on the rotation angles around the first axis (y-axis) and the third axis (x-axis). However, in another example, the deviation determination unit 13 may determine the deviation between the vertical center position of the face in the captured image and a predetermined vertical position on the display, and the deviation between the horizontal center position of the face in the captured image and the horizontal center position on the display, and the display unit 17 may change and display the position of the moving frame w12 relative to the fixed frame w11 based on these deviations.

[0031] More specifically, for example, the deviation determination unit 13 identifies the vertical center position of the face in the captured image based on the detection of the range of the face in the captured image. The deviation determination unit 13 calculates a deviation α3 between the vertical center position of the face and a predetermined vertical position on the display. The deviation determination unit 13 also identifies the horizontal center position of the face in the captured image based on the detection of the range of the face in the captured image. The deviation determination unit 13 calculates a deviation α4 between the horizontal center position of the face and the horizontal center position of the display. The display unit 17 displays the position of the moving frame w12 based on the negative and positive values ​​of the deviation α3 and the negative and positive values ​​of the deviation α4. In this case, the deviation determination unit 13 uses the captured image to determine the deviation, but the display unit 17 may stop displaying the facial image of the user being photographed, acquired via the camera 2, on the display 3.

[0032] This process is an example of a process for determining the degree of deviation from a first reference position and a second reference position when the subject in a captured image acquired by the camera through the terminal device 1 is displayed on the display, acquiring a quality level of the subject, and outputting information indicating the degree of deviation and information indicating the quality level in a manner recognizable by the subject. That is, the reference position of the posture indicated by the fixed frame w11 described above may be defined as a range located at the center of the display 3 and as a reference position of the user's posture relative to the terminal device 1. The reference position of the posture indicated by the fixed frame w11 may also be defined as a reference position on the display 3 where the face would be located if the user were photographed in a posture suitable for photography. In this case, instead of performing display control to move the position on the display 3 based on the rotation angles α1 and α2 of the moving frame w12, the terminal device 1 may perform display control to move the moving frame w12 based on the shooting position of the user's face within the shooting range of the camera 2.

[0033] The deviation determination unit 13 determines whether the rotation angles α1, α2 (or deviations α3, α4) are less than a threshold value (step S102). This process is an example of a process for determining whether the terminal device 1 (smartphone) is vertical. If the rotation angles α1, α2 (or deviations α3, α4) are less than the threshold value, the deviation determination unit 13 outputs this information to the control unit 11. If the rotation angles α1, α2 (or deviations α3, α4) are less than the threshold value, the control unit 11 outputs an instruction to start practice to the display unit 17. The display unit 17 detects the start of practice and outputs to the display 3 a message instructing the user to practice moving the terminal device 1 in parallel up, down, left, right, forward, and backward directions while keeping the terminal device 1 vertical (step S103).

[0034] The user practices moving the terminal device 1 in parallel up, down, left, right, forward, and backward directions while keeping the terminal device 1 vertical. The control unit 11 determines whether the terminal device 1 has moved in parallel up, down, left, right, forward, and backward directions based on values ​​obtained from an acceleration sensor or the like. The control unit 11 acquires rotation angles α1 and α2 from the deviation determination unit 13 at predetermined intervals, such as every 1 ms, and determines whether the absolute values ​​of these angles are less than the threshold for several seconds (step S104). This process is one example of determining whether the practice was successful. While the control unit 11 detects that the terminal device 1 is practicing moving in parallel up, down, left, right, forward, and backward directions based on values ​​obtained from the acceleration sensor, it acquires rotation angles α1 and α2 from the deviation determination unit 13 at predetermined intervals, such as every 1 ms, and determines that the practice was successful if the absolute values ​​of these angles are less than the threshold for several seconds.

[0035] In the above description, it has been explained that the display unit 17 stops displaying the facial image of the user being photographed, acquired via the camera 2, on the display 3 while the deviation determination unit 13 is performing processing. However, the display unit 17 may also control the display of information D1 so that the facial image is clearly displayed as the moving frame w12 approaches the fixed frame w11. Furthermore, the display unit 17 may control the information D1 so that the focus becomes blurred as the two frames, the fixed frame w11 and the moving frame w12, move apart, and the face is gradually displayed in focus as the frames move closer to the optimal position. Alternatively, as another variation, the display unit 17 may control the display of information D1 so that the screen turns completely black as the moving frame w12 moves away from the fixed frame w11, and the black fades as the moving frame w12 approaches the fixed frame w11, allowing the face to be clearly visible. Furthermore, the display unit 17 may control the display of information D1 so that the fixed frame w11 and the moving frame w12 are not displayed.

[0036] If the control unit 11 determines that the practice is successful, it instructs the size determination unit 15 and the display unit 17 to start size determination processing (step S105). The display unit 17 then displays on the display 3 information D2 that allows the degree of agreement between the expected size of the face area in the photographed image displayed on the display 3 and the size of the face area in the photographed image actually displayed on the display.

[0037] As shown in information D2 in Fig. 5 , the display unit 17 outputs information D2 representing a fixed frame w21 and a variable frame w22. The fixed frame w21 indicates the range of face sizes to be displayed on the terminal device 1. The size of the variable frame w22 varies depending on the distance between the camera 2 and the user's face or the size of the range of the face detected in the captured image. The display unit 17 displays the fixed frame 21 in information D2, and when a range of the face is detected from the captured image, it displays a variable frame w22 indicating that range in information D2. The user changes the distance between the terminal device 1 and their face so that the variable frame w22 coincides with the fixed frame 21.

[0038] While the size determination unit 15 is performing the processing, the deviation determination unit 13 is also performing a processing in parallel (step S106). This processing is an example of determining whether the terminal device 1 is significantly deviated from the vertical. If both of the rotation angles α1 and α2 are less than a predetermined threshold, the deviation determination unit 13 outputs information indicating no deviation to the control unit 11. If at least one of the rotation angles α1 and α2 is equal to or greater than a predetermined threshold, the deviation determination unit 13 outputs information indicating a deviation to the control unit 11. When the control unit 11 acquires the information indicating a deviation, it instructs the size determination unit 15 and the display unit 17 to stop the size determination processing and instructs the deviation determination unit 13 and the display unit 17 to start the deviation determination processing. In this case, the display unit 17 stops processing the information D2 and displays the information D1.

[0039] The size determination unit 15 calculates the ratio of the size of the variable frame w22 to the size of the fixed frame w21. The size determination unit 15 determines whether the deviation between the positions of the four rectangular sides of the variable frame w22 and the positions of the four rectangular sides of the fixed frame 21 is less than a threshold value at which it can be determined that they are substantially identical (step S107). If the deviation between the positions of the four rectangular sides of the variable frame w22 and the positions of the four rectangular sides of the fixed frame 21 is less than the threshold value at which it can be determined that they are substantially identical, the size determination unit 15 outputs information indicating a size match to the control unit 11. Upon detecting the information indicating a size match, the control unit 11 instructs the quality determination unit 14 and the display unit 17 to start a quality determination process (step S108). If the deviation between the position of any of the four rectangular sides of the variable frame w22 and the position of any of the corresponding four rectangular sides of the fixed frame 21 is equal to or greater than a threshold value, the size determination unit 15 outputs information indicating a size mismatch to the control unit 11. When the control unit 11 detects the information indicating a size mismatch, it instructs the size determination unit 15 and the display unit 17 to continue the size determination process.

[0040] When the display unit 17 receives an instruction to start the quality assessment process, it displays information D3 on the display 3. The quality assessment unit 14 also calculates the degree of quality in the captured image using a quality assessment algorithm. The quality assessment algorithm may be any algorithm that assesses the quality of a face in the captured image. The quality algorithm may be, for example, one or more of the following: an algorithm that determines whether the captured image is backlit based on the luminance of the image; an algorithm that determines whether the eyes are closed; an algorithm that determines whether the face is dark based on the luminance of the face; or an algorithm that determines whether the difference in luminance between the bright and dark parts of the face is within a threshold. The quality assessment algorithm may calculate a numerical value indicating the magnitude of a single quality based on the numerical values ​​of one or more of these algorithms. The quality assessment unit 14 outputs the numerical value of the quality to the display unit 17. The display unit 17 outputs information D3 including an indicator w32 indicating the numerical value of the quality. A moving frame w22 indicating the range of the detected face may be displayed together with the information D3.

[0041] While the quality determination unit 14 is performing its processing, the deviation determination unit 13 is also performing deviation determination processing in parallel (step S109), and the size determination unit 15 is also performing size determination processing in parallel (step S110). If both rotation angles α1 and α2 are less than a predetermined threshold, the deviation determination unit 13 outputs information indicating no deviation to the control unit 11. If at least one of the rotation angles α1 and α2 is equal to or greater than a predetermined threshold, the deviation determination unit 13 outputs information indicating the presence of deviation to the control unit 11. When the control unit 11 acquires the information indicating the presence of deviation, it instructs the size determination unit 15 and the display unit 17 to stop the size determination processing, and instructs the deviation determination unit 13 and the display unit 17 to start the deviation determination processing. In this case, the display unit 17 stops processing information D3 and displays information D1.

[0042] If the deviation between the positions of the four sides of the rectangle of the variable frame w22 and the positions of the four sides of the rectangle of the fixed frame 21 is less than a threshold value at which it can be determined that they are substantially identical, the size determination unit 15 outputs information indicating a size match to the control unit 11. If the deviation between the position of any of the four sides of the rectangle of the variable frame w22 and the position of a corresponding one of the four sides of the rectangle of the fixed frame 21 is equal to or greater than a threshold value, the size determination unit 15 outputs information indicating a size mismatch to the control unit 11. After instructing the control unit 11 to start the quality determination process, if the control unit 11 detects information indicating a size mismatch, it instructs the quality determination unit 14 and the display unit 17 to stop the quality determination process and instructs the size determination unit 15 and the display unit 17 to start the size determination process. In this case, the display unit 17 stops processing information D3 and displays information D2.

[0043] The quality determination unit 14 outputs a numerical value indicating the degree of quality to the display unit 17. The display unit 17 performs display control to raise or lower the gauge of the value indicating the quality of the indicator w32 based on the degree of quality. When the value indicating the degree of quality is equal to or greater than a threshold, the display unit 17 changes the color of the capture button displayed in the information D3 from white to black. This processing by the display unit 17 is one aspect of a shutter control means that controls a user interface that enables the saving of a captured image when the degree of misalignment is equal to or less than a threshold, the degree of size match is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold. The user determines that a capture is possible based on the change in color of the capture button and presses the capture button. The control unit 11 determines whether the capture button has been pressed (step S111). If the capture button has been pressed, the control unit 11 controls the camera 2 to capture an image (step S112). Alternatively, the storage unit 16 identifies the captured image acquired at the timing when the capture button is pressed, among images acquired from the camera 2 at predetermined intervals, and records the identified image in the storage device 104, etc. The storage unit 16 may transmit the recorded captured image to an output destination such as a predetermined server.

[0044] In another aspect, when the value indicating the degree of quality becomes equal to or greater than a threshold value, the quality determination unit 14 may automatically control the camera 2 to photograph the user's face, and the storage unit 16 may automatically record the photographed image in the storage device 104 or the like. In this case, the quality determination unit 14 may identify the photographed image with the highest quality from among the plurality of photographed images acquired by each of the plurality of consecutive photographs using a predetermined quality algorithm, and the storage unit 16 may record the identified photographed image in the storage device 104. This processing by the storage unit 16 is one aspect of processing for identifying and storing photographed images to be stored from among the plurality of photographed images taken at predetermined intervals after photographing of the subject has begun.

[0045] The above process allows the terminal device 1 to record a facial image in which the terminal is held upright, the user's vertical orientation matches the vertical orientation of the image, the facial image is displayed straight, the size of the face is appropriate, and the quality is calculated to be good by the quality assessment algorithm. This allows the terminal device 1 to generate an appropriate facial image of the user through authentication processing, etc.

[0046] The display examples of information D1, information D2, and information D3 shown in FIG. 5 in the above-described processing are merely examples. For example, the fixed frame w11, moving frame w12, fixed frame 21, and moving frame w22 may not be rectangular. The terminal device 1 of the present disclosure may perform processing only by the deviation determination unit 13, processing only by the quality determination unit 14, and processing only by the size determination unit 15. Alternatively, the terminal device 1 may perform processing by the size determination unit 15 and processing by the quality determination unit 14 interchangeably.

[0047] The processing order may be the displacement determination process, size determination process, and quality determination process shown in FIG. 6 , or may be different. Even if the orientation of the terminal device 1 is determined in the quality determination process to optimize the influence of light (such as lighting) on ​​the captured image, correcting the orientation in the displacement determination process may disrupt the lighting conditions. Therefore, a better image can be generated by determining the orientation of the terminal device 1 through the displacement determination process and then moving and rotating the terminal device 1 while keeping the upper body fixed to determine the appropriate lighting conditions. Furthermore, by performing the size determination process after the displacement determination process, the user can set the displacement determination process using shoulder movement, and then determine the size of the face image using wrist and elbow movement. If size determination is performed first and then the displacement determination process is performed, adjustments such as the distance of the terminal device 1 to the face during size determination may be disrupted when adjusting the displacement determination process. Therefore, it is preferable to perform the displacement determination process first and then the size determination process.

[0048] In related technology, using a dedicated photographer to capture a user's facial image is costly and time-consuming. Furthermore, when a user photographs their own face using the selfie function of a terminal device 1 such as a smartphone, not everyone is able to properly capture a high-quality selfie image, resulting in poor image quality and reduced facial recognition accuracy. Furthermore, there are a certain number of cases where users typically hold the terminal device 1 such as a smartphone below their face and photograph themselves while looking down. In this position, the face is photographed from below, which can cause distortion of the face, and the background, such as lighting or the sky, can be bright and backlit, resulting in problems with the captured image. The processing of the terminal device 1 disclosed herein solves these issues, allowing users to capture high-quality images suitable for predetermined processing such as facial recognition by simply taking a photo using their smartphone, without incurring the cost of a photo shoot by a photographer or the like.

[0049] (Another embodiment 1) Figure 7 is a diagram showing an example of another information processing system of the present disclosure. In the above-described processing, the terminal device 1 has been used as an example of the information processing device 20. However, the information processing device 20 of the present disclosure may be a computer installed on a table, such as a PC, or may be a computer fixed to a wall or the like. In this case, the information processing device 20 also includes the same hardware configuration as shown in Figure 3 except for the sensor 106, and the camera 2 includes the sensor 106, and the information processing device 20 performs the functions shown in Figure 4.

[0050] In this case, the terminal device 1 may further include a drive mechanism for changing the shooting direction of the camera 2. Then, the rotation of each axis of the camera 2, such as the first axis (y-axis) and the third axis (x-axis), may be controlled, and the same processing as described above may be performed in the deviation determination, so that the deviation is controlled appropriately in the deviation determination processing, the size of the face area is controlled to a predetermined size in the size determination processing, and the position of the camera 2 may be controlled so that the quality numerical value is equal to or greater than a threshold in the quality determination processing.

[0051] As shown in FIG. 7, the camera 2 and the display 3 may be configured as separate entities from the information processing device 20, and the information processing device 20 may control the attitude, angle of view, and position of the camera 2 to which it is connected in communication, thereby similarly performing the above-mentioned deviation determination process and size determination process.

[0052] Furthermore, the information processing device 20 may output information such as the positional relationship between the fixed frame w11 and the moving frame w12 in information D1, the positional relationship between the fixed frame w1 and the moving frame w22 in information D2, and the numerical value of the indicator in information D3, using human voice or sound from the communicatively connected speaker 4 via the audio output unit 18. This allows the user to determine the appropriate position of their face relative to the camera 2 based on the human voice or sound information, without visually checking the display 3, even if the camera 2 and the terminal device 1 are separate entities.

[0053] (Another Embodiment 2) FIG. 8 is a first diagram showing functional blocks of another information processing device of the present disclosure. FIG. 9 is a first diagram showing a processing flow of another information processing device of the present disclosure. The information processing device 20 of the present disclosure may include at least a deviation determination unit 51 and an output unit 52. The deviation determination unit 51 determines the degree of deviation of the camera's orientation from a reference position relative to the subject based on the orientation of the terminal device 1 equipped with the camera (step S501). The output unit 52 outputs information indicating the degree of deviation so that the subject can recognize it (step S502). In this embodiment, the information processing device 20 may change the color of the capture button displayed together with information D1 to a state where the user can operate it. For example, the information processing device 20 changes the color of the capture button displayed together with information D1 from white to black. This processing is a processing aspect of controlling a user interface that enables the user to operate the saving of a captured image when the degree of deviation is below the threshold. The user determines that the capture button can be used based on the change in color of the capture button and presses the capture button. Furthermore, when the degree of misalignment is equal to or less than a threshold, the information processing device 20 may automatically control the camera 2 to photograph the user's face, and the photographed image obtained by the photographing may be automatically recorded by the information processing device 20 in the storage device 104, etc. Furthermore, in this embodiment, the information processing device 20 may identify the photographed image having the smallest value indicating the degree of misalignment among the plurality of photographed images obtained by each of the plurality of consecutive photographing operations, and record the identified photographed image in the storage device 104.

[0054] (Other Embodiment 3) Fig. 10 is a second diagram showing functional blocks of another information processing device of the present disclosure. Fig. 11 is a second diagram showing a processing flow of another information processing device of the present disclosure. The information processing device 20 of the present disclosure may include at least quality acquisition means 61 and output means 62. In this case, the quality acquisition means 61 acquires a quality level of the subject to be photographed (step S601). The output means 62 outputs information indicating the quality level in a manner recognizable by the subject to be photographed (step S602).

[0055] (Other Embodiment 4) FIG. 12 is a third diagram showing functional blocks of another information processing device of the present disclosure. FIG. 13 is a third diagram showing a processing flow of another information processing device of the present disclosure. The information processing device 20 of the present disclosure may include at least a size determination unit 71 and an output unit 72. In this case, the size determination unit 71 determines the degree of agreement between the expected size of the face area of ​​the subject in the captured image displayed on the display and the actual size of the face area of ​​the subject in the captured image displayed on the display (step S701). The output unit 72 outputs information indicating the degree of agreement in the size of the face area in a manner recognizable by the subject (step S702). In this embodiment, the information processing device 20 may change the color of the capture button displayed together with information D2 from white to black. This processing is a processing aspect for controlling a user interface that enables the user to operate the saving of a captured image when the degree of agreement in the size of the face area is equal to or greater than a threshold. The user determines that a photograph can be taken based on the change in color of the photograph button and presses the photograph button. Furthermore, when the degree of match in the size of the face area is equal to or greater than a threshold, the information processing device 20 may automatically control the camera 2 to photograph the user's face, and the photographed image obtained by the photograph may be automatically recorded in the storage device 104 or the like. Furthermore, in this embodiment, the information processing device 20 may identify the photographed image that exhibits the highest degree of match in the size of the face area from among the plurality of photographed images obtained by each of the plurality of consecutive photographs, and record the identified photographed image in the storage device 104.

[0056] (Other Embodiment 5) FIG. 14 is a fourth diagram showing functional blocks of another information processing device of the present disclosure. FIG. 15 is a fourth diagram showing a processing flow of another information processing device of the present disclosure. The information processing device 20 of the present disclosure may also include at least a deviation determination unit 81, a quality acquisition unit 82, and an output unit 83. The deviation determination unit 81 determines the degree of deviation from a reference position in the vertical direction and the horizontal direction when the subject appears in a captured image acquired from a camera by capturing the subject and displayed on a display (step S801). The quality acquisition unit 82 acquires the quality level of the subject (step S802). The output unit 83 outputs information indicating the degree of deviation and information indicating the quality level in a manner recognizable by the subject (step S803).

[0057] According to each aspect of the information processing device described above, it is possible to obtain an image that is more suitable for predetermined processing such as authentication using a face image of a person to be photographed.

[0058] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0059] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0060] (Supplementary Note 1) An information processing device comprising: a detection means for detecting the attitude of a terminal device equipped with a camera; a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera with respect to a subject to be photographed based on the attitude; and an output means for outputting information indicating the degree of deviation in a manner recognizable by the subject to be photographed.

[0061] (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the deviation determination means determines the degree of deviation of a first axis indicating the shooting direction of the camera and coinciding with the normal to the plane of the display of the terminal device, a second axis indicating an axis perpendicular to the first axis and coinciding with the up-down direction of the plane of the display, and a third axis perpendicular to both the first and second axes, the degree of deviation indicating whether the plane of the display is vertical based on rotation of the third axis, and the degree of deviation indicating whether the up-down direction of the subject to be shot and the up-down direction of the display coincide with each other based on rotation of the first axis.

[0062] (Supplementary Note 3) The information processing device according to Supplementary Note 2, further comprising: a quality acquisition unit that acquires a quality level of the subject to be photographed; and the output unit that outputs information indicating the quality level.

[0063] (Appendix 4) An information processing device as described in Appendix 3, comprising: a size determination means for determining the degree of correspondence between the size that the facial area of ​​the subject in the captured image displayed on the display should be and the size of the facial area of ​​the subject in the captured image actually displayed on the display.

[0064] (Supplementary Note 5) The information processing device according to Supplementary Note 4, further comprising: a storage unit configured to store a captured image when the degree of deviation is equal to or less than a threshold, the degree of coincidence of size is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0065] (Supplementary Note 6) The information processing device according to Supplementary Note 5, wherein the saving means saves a plurality of captured images at predetermined intervals from when photography of the subject begins, and identifies and saves the captured image to be saved from among the captured images.

[0066] (Supplementary Note 7) The information processing device according to Supplementary Note 5 or Supplementary Note 6, further comprising: a shutter control means for controlling a user interface that enables the user to operate the saving of a captured image when the degree of deviation is equal to or less than a threshold, the degree of size coincidence is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0067] (Supplementary Note 8) The information processing device described in any one of Supplementary Note 4 to Supplementary Note 7, wherein the output means stops displaying the captured image generated by shooting on the display when determining the degree of deviation, and starts displaying the captured image on the display when the degree of deviation in the determination result of the degree of deviation is equal to or less than a threshold value.

[0068] (Supplementary Note 9) An information processing device described in any one of Supplementary Note 4 to Supplementary Note 8, wherein the degree of size matching is determined when the degree of each deviation in the determination result of the degree of deviation is below a threshold, and the quality degree is determined when the determination result of the degree of size matching is above a threshold.

[0069] (Supplementary Note 10) The information processing device described in any one of Supplementary Note 1 to Supplementary Note 9, wherein the deviation determination means determines the degree of deviation of the posture from a reference position where a predetermined position within the range of the display of the terminal device coincides with a position where the subject shown on the display in the captured image acquired from the camera is the reference position.

[0070] (Supplementary Note 11) The information processing device according to any one of Supplementary Note 1 to Supplementary Note 10, wherein the output means performs control such that the clarity of the display of the captured image acquired from the camera on the display of the terminal device becomes clearer as the degree of deviation becomes smaller.

[0071] (Supplementary Note 12) An information processing device comprising: a deviation determination means for determining the degree of deviation from a reference position in the vertical direction and the horizontal direction when the subject to be photographed, which appears in an image acquired from a camera by photographing the subject, is displayed on a display; a quality acquisition means for acquiring a quality level of the subject to be photographed; and an output means for outputting information indicating the degree of deviation and information indicating the quality level in a manner that can be recognized by the subject to be photographed.

[0072] (Supplementary Note 13) An information processing device according to Supplementary Note 12, comprising: a size determination means for determining a degree of correspondence between the size that the face area of ​​the subject in the photographed image displayed on the display should be and the size of the face area of ​​the subject in the photographed image actually displayed on the display; and the output means for outputting information indicating the degree of correspondence in size.

[0073] (Supplementary Note 14) An information processing method comprising: detecting an attitude of a terminal device equipped with a camera; determining a degree of deviation of the attitude from a reference position of the camera with respect to a subject to be photographed based on the attitude; and outputting information indicating the degree of deviation in a manner recognizable by the subject to be photographed.

[0074] (Supplementary Note 15) The information processing method described in Supplementary Note 14 determines the degree of deviation of a first axis indicating the shooting direction of the camera and coinciding with the normal to the plane of the display of the terminal device, a second axis indicating an axis perpendicular to the first axis and coinciding with the up-down direction of the plane of the display, and a third axis perpendicular to both the first and second axes, indicating whether the plane of the display is vertical or not based on rotation of the third axis, and whether the up-down direction of the subject to be shot and the up-down direction of the display are coincident based on rotation of the first axis.

[0075] (Supplementary Note 16) The information processing method according to Supplementary Note 15, further comprising: acquiring a quality level of the subject; and outputting information indicating the quality level.

[0076] (Supplementary Note 17) The information processing method described in Supplementary Note 16, which determines the degree of correspondence between the size that the face area of ​​the subject in the captured image displayed on the display should be and the size of the face area of ​​the subject in the captured image actually displayed on the display.

[0077] (Supplementary Note 18) The information processing method according to Supplementary Note 17, wherein the captured image is saved when the degree of deviation is equal to or less than a threshold, the degree of coincidence of size is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0078] (Supplementary Note 19) The information processing method according to Supplementary Note 18, wherein a plurality of captured images are saved at predetermined intervals from when photography of the subject begins, and the captured image to be saved is identified from among the captured images and saved.

[0079] (Supplementary Note 20) The information processing method according to Supplementary Note 18 or Supplementary Note 19, wherein a user interface is controlled to enable saving of a captured image when the degree of deviation is equal to or less than a threshold, the degree of size coincidence is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0080] (Supplementary Note 21) The information processing method described in any one of Supplementary Note 17 to Supplementary Note 20, wherein display of the captured image generated by shooting on the display is stopped in determining the degree of deviation, and when the degree of deviation in the determination result of the degree of deviation is equal to or less than a threshold, display of the captured image on the display is started.

[0081] (Supplementary Note 22) An information processing method described in any one of Supplementary Notes 17 to 21, in which the degree of size matching is determined when the degree of each deviation in the determination result of the degree of deviation is below a threshold, and the quality degree is determined when the determination result of the degree of size matching is above a threshold.

[0082] (Supplementary Note 23) An information processing method described in any one of Supplementary Notes 14 to 22, in which the degree of deviation of the posture from a reference position where a predetermined position within the range of the display of the terminal device coincides with the position where the subject appears on the display in the captured image acquired from the camera is determined as the reference position.

[0083] (Supplementary Note 24) The information processing method according to any one of Supplementary Note 14 to Supplementary Note 23, wherein control is performed such that the clarity of the display of the captured image acquired from the camera on the display of the terminal device becomes clearer as the degree of the deviation becomes smaller.

[0084] (Supplementary Note 25) An information processing method comprising: a deviation determination means for determining the degree of deviation from a reference position in the vertical direction and the horizontal direction when the subject shown in an image acquired from a camera by photographing the subject is displayed on a display; a quality acquisition means for acquiring a quality level of the subject; and an output means for outputting information indicating the degree of deviation and information indicating the quality level in a manner that can be recognized by the subject.

[0085] (Appendix 26) An information processing method according to Appendix 25, which determines the degree of correspondence between the size that the facial area of ​​the subject in the captured image displayed on the display should be and the size of the facial area of ​​the subject in the captured image actually displayed on the display, and outputs information indicating the degree of correspondence in size.

[0086] (Supplementary Note 27) A storage medium storing a program that causes a computer to function as: a detection means for detecting the attitude of a terminal device equipped with a camera; a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera with respect to a subject to be photographed based on the attitude; and an output means for outputting information indicating the degree of deviation in a manner that can be recognized by the subject to be photographed.

[0087] (Supplementary Note 28) A storage medium for storing a program described in Supplementary Note 27, wherein the deviation determination means determines the degree of each of the deviations among a first axis indicating the shooting direction of the camera and coinciding with the normal to the plane of the display of the terminal device, a second axis indicating an axis perpendicular to the first axis and coinciding with the up-down direction of the plane of the display, and a third axis perpendicular to both the first and second axes: a deviation indicating whether the plane of the display is vertical based on rotation of the third axis; and a deviation indicating whether the up-down direction of the subject to be shot and the up-down direction of the display based on rotation of the first axis.

[0088] (Supplementary Note 29) A storage medium storing the program according to Supplementary Note 28, which functions as quality acquisition means for acquiring a quality level of the subject to be photographed, and the output means outputs information indicating the quality level.

[0089] (Supplementary Note 30) A storage medium that stores the program described in Supplementary Note 29, which functions as a size determination means that determines the degree of correspondence between the size that the facial area of ​​the subject in the captured image displayed on the display should be and the size of the facial area of ​​the subject in the captured image actually displayed on the display.

[0090] (Supplementary Note 31) A storage medium that stores the program according to Supplementary Note 30, which functions as a storage unit that stores a captured image when the degree of deviation is equal to or less than a threshold, the degree of coincidence of the size is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0091] (Supplementary Note 32) The storage medium for storing the program according to Supplementary Note 31, wherein the saving means saves a plurality of captured images at predetermined intervals from when photography of the subject begins, and identifies and saves the captured image to be saved from among the plurality of captured images.

[0092] (Supplementary Note 33) A storage medium storing the program according to Supplementary Note 31 or Supplementary Note 32, which functions as a shutter control means for controlling a user interface that enables the user to operate the saving of a captured image when the degree of deviation is equal to or less than a threshold, the degree of coincidence of the size is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0093] (Appendix 34) A storage medium storing a program according to any one of Appendices 31 to 33, wherein the output means stops displaying the captured image generated by photographing on the display when determining the degree of deviation, and starts displaying the captured image on the display when the degree of deviation in the determination result of the degree of deviation is equal to or less than a threshold value.

[0094] (Appendix 35) A storage medium storing a program described in any one of Appendices 31 to 34, wherein the degree of size coincidence is determined when the degree of each deviation in the result of the deviation degree determination is below a threshold, and the quality degree is determined when the result of the size coincidence determination is above a threshold.

[0095] (Appendix 36) The deviation determination means determines the degree of deviation of the posture from a reference position where a predetermined position within the range of the display of the terminal device coincides with a position where the subject shown on the display in the captured image acquired from the camera is the reference position. A storage medium that stores a program according to any one of Appendices 27 to 35.

[0096] (Appendix 37) A storage medium storing a program according to any one of Appendices 27 to 36, wherein the output means performs control so that the clarity of the display of the captured image acquired from the camera on the display of the terminal device becomes clearer as the degree of deviation becomes smaller.

[0097] (Appendix 38) A storage medium for storing a program including: a deviation determination means for determining the degree of deviation from a reference position in the vertical direction and the horizontal direction when the subject shown in an image acquired from a camera by photographing the subject is displayed on a display; a quality acquisition means for acquiring a quality level of the subject; and an output means for outputting information indicating the degree of deviation and information indicating the quality level in a manner that can be recognized by the subject.

[0098] (Appendix 39) A storage medium for storing the program described in Appendix 38, comprising: a size determination means for determining the degree of correspondence between the size that the facial area of ​​the subject in the captured image displayed on the display should be and the size of the facial area of ​​the subject in the captured image actually displayed on the display; and the output means for outputting information indicating the degree of correspondence between the sizes.

[0099] (Supplementary Note 40) An information processing system comprising: a detection means for detecting the attitude of a terminal device equipped with a camera; a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera with respect to a subject to be photographed based on the attitude; and an output means for outputting information indicating the degree of deviation in a manner recognizable by the subject to be photographed.

[0100] (Supplementary Note 41) The information processing system described in Supplementary Note 40, wherein the deviation determination means determines the degree of each of the deviations among a first axis indicating the shooting direction of the camera and coinciding with the normal to the plane of the display of the terminal device, a second axis indicating an axis perpendicular to the first axis and coinciding with the up-down direction of the plane of the display, and a third axis perpendicular to both the first axis and the second axis: a deviation indicating whether the plane of the display is vertical based on rotation of the third axis; and a deviation indicating whether the up-down direction of the subject to be shot and the up-down direction of the display based on rotation of the first axis.

[0101] (Supplementary Note 42) The information processing system according to Supplementary Note 41, further comprising: a quality acquisition means for acquiring a quality level of the subject to be photographed; and the output means for outputting information indicating the quality level.

[0102] (Appendix 43) An information processing system as described in Appendix 42, comprising: a size determination means for determining the degree of correspondence between the size that the facial area of ​​the subject in the captured image displayed on the display should be and the size of the facial area of ​​the subject in the captured image actually displayed on the display.

[0103] (Supplementary Note 44) The information processing system according to Supplementary Note 43, further comprising: a storage unit configured to store a captured image when the degree of deviation is equal to or less than a threshold, the degree of coincidence of size is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0104] (Supplementary Note 45) The information processing system according to Supplementary Note 44, wherein the saving means saves a plurality of captured images at predetermined intervals from when photography of the subject begins, and identifies and saves the captured images to be saved from among the captured images.

[0105] (Supplementary Note 46) The information processing system according to Supplementary Note 44 or Supplementary Note 45, further comprising: a shutter control means for controlling a user interface that enables the user to operate the saving of a captured image when the degree of deviation is equal to or less than a threshold, the degree of size coincidence is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

[0106] (Appendix 47) The information processing system described in any one of Appendices 43 to 46, wherein the output means stops displaying the captured image generated by shooting on the display when determining the degree of deviation, and starts displaying the captured image on the display when the degree of deviation in the determination result of the degree of deviation is equal to or less than a threshold value.

[0107] (Appendix 48) An information processing system described in any one of Appendices 43 to 47, wherein the degree of size matching is determined when the degree of each deviation in the determination result of the degree of deviation is below a threshold, and the quality degree is determined when the determination result of the degree of size matching is above a threshold.

[0108] (Appendix 49) The information processing system described in any one of Appendices 40 to 48, wherein the deviation determination means determines the degree of deviation of the posture from a reference position where a predetermined position within the range of the display of the terminal device coincides with a position where the subject shown on the display in the captured image acquired from the camera is the reference position.

[0109] (Appendix 50) The information processing system according to any one of Appendices 40 to 49, wherein the output means performs control such that the clarity of the display of the captured image acquired from the camera on the display of the terminal device becomes clearer as the degree of deviation becomes smaller.

[0110] (Supplementary Note 51) An information processing system comprising: a deviation determination means for determining the degree of deviation from a reference position in the vertical direction and the horizontal direction when the subject to be photographed, which appears in an image acquired from a camera by photographing the subject, is displayed on a display; a quality acquisition means for acquiring a quality level of the subject to be photographed; and an output means for outputting information indicating the degree of deviation and information indicating the quality level in a manner that can be recognized by the subject to be photographed.

[0111] (Appendix 52) An information processing system as described in Appendix 51, comprising: a size determination means for determining the degree of correspondence between the size that the facial area of ​​the subject in the photographed image displayed on the display should be and the size of the facial area of ​​the subject in the photographed image actually displayed on the display; and the output means for outputting information indicating the degree of correspondence in size.

[0112] DESCRIPTION OF SYMBOLS 1: Terminal device 2: Camera 3: Display 11: Control unit 12: Acquisition unit 13: Deviation determination unit 14: Quality determination unit 15: Size determination unit 16: Storage unit 17: Display unit 18: Audio output unit 19: UI unit

Claims

1. An information processing device comprising: a detection means for detecting the attitude of a terminal device equipped with a camera; a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera relative to a subject to be photographed based on the attitude; and an output means for outputting information indicating the degree of deviation in a manner recognizable by the subject to be photographed.

2. The information processing device of claim 1, wherein the deviation determination means determines the degree of deviation of a first axis indicating the shooting direction of the camera and coinciding with the normal to the plane of the display of the terminal device, a second axis indicating an axis perpendicular to the first axis and coinciding with the up-down direction of the plane of the display, and a third axis perpendicular to both the first and second axes, the degree of deviation indicating whether the plane of the display is vertical based on rotation of the third axis, and the degree of deviation indicating whether the up-down direction of the subject to be shot and the up-down direction of the display are coincident based on rotation of the first axis.

3. An information processing device according to claim 2, further comprising: quality acquisition means for acquiring a quality level of the subject to be photographed; and said output means for outputting information indicating said quality level.

4. An information processing device as described in claim 3, further comprising a size determination means for determining the degree of correspondence between the size of the face area of ​​the subject in the captured image displayed on the display and the size of the face area of ​​the subject in the captured image actually displayed on the display.

5. The information processing device according to claim 4, further comprising: a storage means for storing a captured image when the degree of deviation is equal to or less than a threshold, the degree of size agreement is equal to or greater than a threshold, and the degree of quality is equal to or greater than a threshold.

6. The information processing device according to claim 5, wherein the storage means stores a plurality of captured images at predetermined intervals from when photography of the subject begins, and identifies and stores the captured image to be saved from among the captured images.

7. An information processing device as described in claim 4 or claim 5, further comprising: a shutter control means for controlling a user interface that enables the user to operate the saving of a captured image when the degree of deviation is below a threshold, the degree of size matching is above a threshold, and the quality degree is above a threshold.

8. The information processing device according to claim 6, wherein the output means stops displaying the captured image generated by the photographing on the display when determining the degree of deviation, and starts displaying the captured image on the display when the degree of deviation in the determination result of the degree of deviation is equal to or less than a threshold value.

9. An information processing device as described in claim 5, wherein the degree of size coincidence is determined when the degree of each deviation in the deviation degree determination result is below a threshold, and the quality degree is determined when the size coincidence determination result is above a threshold.

10. The information processing device according to claim 1, wherein the deviation determination means determines the degree of deviation of the posture from a reference position where a predetermined position within the display range of the terminal device coincides with the position of the subject shown on the display in the captured image acquired from the camera.

11. The information processing device according to claim 1, wherein the output means performs control so that the smaller the degree of deviation, the clearer the display of the captured image acquired from the camera on the display of the terminal device becomes.

12. An information processing device comprising: a deviation determination means for determining the degree of deviation from a reference position in the vertical direction and the horizontal direction when the subject appears in an image acquired from a camera by photographing the subject and is displayed on a display; a quality acquisition means for acquiring a quality level of the subject; and an output means for outputting information indicating the degree of deviation and information indicating the quality level in a manner that can be recognized by the subject.

13. An information processing device as described in claim 12, further comprising a size determination means for determining the degree of correspondence between the size that the facial area of ​​the subject in the captured image displayed on the display should be and the size of the facial area of ​​the subject in the captured image actually displayed on the display, and wherein the output means outputs information indicating the degree of correspondence in size.

14. An information processing method comprising: detecting the attitude of a terminal device equipped with a camera; determining the degree of deviation of the attitude from a reference position of the camera relative to a subject based on the attitude; and outputting information indicating the degree of deviation in a manner recognizable by the subject.

15. A storage medium storing a program that causes a computer of an information processing device to function as: a detection means for detecting the attitude of a terminal device equipped with a camera; a deviation determination means for determining the degree of deviation of the attitude from a reference position of the camera relative to a subject to be photographed based on the attitude; and an output means for outputting information indicating the degree of deviation in a manner that can be recognized by the subject to be photographed.

Images