Terminal device

Abstract

Provided is a terminal device that can easily photograph a measurement subject and measure bioinformation for the measurement subject. A terminal device (100) comprises an information acquisition unit (11) that acquires an image of a measurement subject captured by a photography unit (2), a slope detection unit (13) that detects the slope of the face of the measurement subject on the screen of a display unit (4) on the basis of a facial image of the measurement subject included in the image captured by the photography unit, and a display control unit (17) that displays a first indicator image that has been matched to the slope of the face detected by the slope detection unit on top of an image displayed at the screen of the display unit that includes the measurement subject.

Description

[Technical Field]

[0001] The present invention relates to a terminal device that measures biological information of a subject in a non-contact manner. [Background Art]

[0002] Conventionally, there has been known a technique of superimposing an indicator image on an image of a subject and displaying the resultant image. For example, Patent Document 1 discloses a video processing system that synthesizes a user's captured video and an outline (indicator image) of a model mover in a model video as a display video, and displays the display video. In addition, Patent Document 2 discloses an image display control device that generates a face display frame (indicator image) surrounding a face region of a subject and a human body display frame (indicator image) surrounding a human body region of the subject, and displays these display frames on a screen together with an image obtained as a result of capturing the subject.

[0003] In addition, the above-described technique can be particularly applied to a terminal device that measures biological information of a subject based on a captured image of the subject (person to be photographed). In such a terminal device for measuring biological information, it is important to continuously capture images of the subject at a predetermined measurement position on a screen of a display unit. Therefore, the terminal device superimposes an indicator image (a face position guide, a human-shaped outline guide, etc.) indicating the measurement position on an image including the subject, and displays the resultant on the screen of the display unit. [Prior Art Documents] [Patent Documents]

[0004] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2010-258613 [Patent Document 2] Japanese Unexamined Patent Application Publication No. 2012-165174 [Summary of the Invention] [Problem to be Solved by the Invention]

[0005] However, in the technologies described above, the indicator image is fixed on the display screen. Therefore, for example, if a measurer operating a terminal device is photographing a subject lying down, the measurer needs to rotate the terminal device so that the subject lying down is aligned with the indicator image. Consequently, there is a concern that the measurer may find this inconvenient or that they may unintentionally move the terminal device and fail to perform the measurement.

[0006] One aspect of the present invention has been made in view of the above-mentioned problems, and its purpose is to provide a terminal device that can easily photograph a subject and measure the subject's biological information. [Means for solving the problem]

[0007] To solve the above problems, a terminal device according to one aspect of the present invention comprises: an imaging unit; a display unit; an information acquisition unit that acquires an image of a person to be measured taken by the imaging unit as information for measuring the biological information of the person to be measured; a tilt detection unit that detects the tilt of the person to be measured on the screen of the display unit based on the face image of the person to be measured included in the image taken by the imaging unit; and a display control unit that superimposes a first index image, which matches the tilt of the face detected by the tilt detection unit, onto an image including the person to be measured that is displayed on the screen of the display unit. [Effects of the Invention]

[0008] According to one aspect of the present invention, a terminal device can be provided that can easily photograph a person being measured and measure their biological information. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram showing the schematic configuration of a terminal device according to one embodiment of the present invention. [Figure 2] This figure shows an example of an image displayed by the terminal device when measuring a subject in a seated or standing position. [Figure 3]This figure shows an example of an image displayed by the terminal device during measurement of a subject lying down. [Figure 4] This figure shows an example of an image displayed by the terminal device when measuring a subject whose face is turned to the side. [Figure 5] This figure shows an example of an image displayed by the terminal device when the position of the subject's face on the display unit's screen shifts within a predetermined range. [Figure 6] This figure shows another example of the image displayed by the terminal device when the position of the subject's face on the display unit's screen shifts within a predetermined range. [Figure 7] This diagram shows the image displayed by the terminal device when the size of the subject's face on the display screen falls below a predetermined threshold. [Figure 8] This figure shows an example of an image displayed by the terminal device when a measurement failure is identified by the situation identification unit. [Figure 9] This figure shows another example of an image displayed by the terminal device when a measurement failure is identified by the situation identification unit. [Figure 10] This figure shows an example of an image displayed by the terminal device when the position of the subject's face on the display screen shifts beyond a predetermined range. [Figure 11] This flowchart shows an example of how a terminal device operates. [Figure 12] This figure shows the image displayed by the terminal device based on the completion of the measurement of the subject's biological information. [Figure 13] This figure shows the gradual change from the second index image to the first index image. [Modes for carrying out the invention]

[0010] [Embodiment 1] (1. Outline configuration of terminal device 100) FIG. 1 is a block diagram showing a schematic configuration of a terminal device according to the present embodiment. As shown in FIG. 1, a terminal device 100 includes a control unit 1, an imaging unit 2, an input unit 3, a display unit 4, a communication unit 5, and a storage unit 6. The terminal device 100 is a device used for measuring biological information of a subject based on a captured image of the subject (that is, in a non-contact manner). Examples of biological information items include, but are not limited to, the body temperature, blood pressure, pulse rate, and respiratory rate of the subject. The terminal device 100 only needs to have an image acquisition function and an image display function, and may be, for example, a smartphone or a tablet terminal.

[0011] A measurer measures the biological information of the subject by using the terminal device 100 to continuously capture images of the subject while checking the image including the subject displayed on the screen of the display unit 4. Such a terminal device 100 is used, for example, in a nursing care site when a caregiver (measurer) measures biological information of a care recipient (subject).

[0012] Note that each function of the terminal device 100 described below can also be realized by installing a program on a general-purpose computer. The above program can also be referred to as application software. Hereinafter, an example in which the terminal device 100 is a smartphone installed with the above program will be described.

[0013] The control unit 1 generally controls each unit of the terminal device 100 in an integrated manner. The imaging unit 2 captures images. The input unit 3 receives input operations performed on the terminal device 100. The display unit 4 has a screen and displays an image captured by the imaging unit 2 on the screen. The communication unit 5 transmits and receives various data between an external communication device and the control unit 1. The storage unit 6 stores various data handled by the terminal device 100. The input unit 3 may be a touch panel, and in this case, the input unit 3 is configured integrally with the display unit 4.

[0014] The control unit 1 includes an information acquisition unit 11, a measurement unit 12, an inclination detection unit 13, an orientation detection unit 14, a size detection unit 15, a situation identification unit 16, and a display control unit 17.

[0015] The information acquisition unit 11 acquires an image of the subject captured by the imaging unit 2 (hereinafter referred to as a captured image) as information for measuring biological information of the subject. The captured image may be a moving image of the subject or a still image of the subject.

[0016] The measurement unit 12 measures biological information of the subject based on the captured image. An external server may measure the biological information of the subject instead of the measurement unit 12. In this case, the captured image acquired by the information acquisition unit 11 is transmitted to the external server via the communication unit 5.

[0017] The inclination detection unit 13 detects the inclination of the face of the subject on the screen of the display unit 4 based on the face image of the subject included in the captured image acquired by the information acquisition unit 11 (hereinafter simply referred to as the face image). The inclination of the face is calculated from the center line of the face. The center line is, for example, a straight line connecting the center of the nose and the center of the mouth, or a straight line connecting the centers of the right eye and the left eye. The orientation detection unit 14 detects whether the face of the subject is turned sideways on the screen of the display unit 4 based on the face image. The size detection unit 15 detects the size of the face of the subject on the screen of the display unit 4 based on the face image.

[0018] Here, the "inclination of the face" of the subject on the screen of the display unit 4 refers to the angle formed between the center line of the face and a predetermined reference direction on the screen, such as the vertical direction parallel to the vertical side of the display screen or the horizontal direction parallel to the horizontal side of the display screen.

[0019] The situation identification unit 16 identifies a situation related to measurement. The situation identification unit 16 identifies unmeasurable items among the biological information items of a predetermined measurement target based on the captured image of the subject. The situation identification unit 16 also identifies that the measurement of biological information has failed, that the measurement of biological information has been completed, and the like.

[0020] The display control unit 17 displays the captured image on the screen of the display unit 4. Hereinafter, the image including the person being measured that is displayed on the screen will be referred to as the display image. The display control unit 17 displays a first indicator image 51 that matches the tilt of the face detected by the tilt detection unit 13, superimposed on the display image to instruct the person being measured to continue taking pictures without changing the position of the person's face (see Figures 2 to 9).

[0021] The first indicator image 51 may be a human-shaped contour guide including the face and shoulders. Here, the first indicator image 51 may be generated by rotating a contour guide selected from a plurality of human-shaped contour guides pre-stored in the memory unit 6 based on the tilt of the face detected by the tilt detection unit 13. Alternatively, the first indicator image 51 may be generated by extracting the contours of the subject's face and shoulders included in the captured image.

[0022] Furthermore, the display control unit 17 may superimpose a second indicator image 52 onto the display image before the measurement unit 12 starts measuring, to help the measurer align the subject's face position with a predetermined position on the display unit 4's screen (see Figures 2, 3, and 9). In this case, after the measurement starts, the display control unit 17 superimposes a first indicator image 51, which is a human-shaped contour guide including the face and shoulder areas, onto the display image.

[0023] The second indicator image 52 may be a frame-shaped guide that positions the subject's face, as displayed on the screen, within the frame. The size of the frame-shaped guide is such that when the person taking the measurement photographs the subject's face at approximately the same size as the frame-shaped guide, the distance between the subject and the terminal device 100 becomes an appropriate distance (e.g., 50-60 cm) corresponding to the performance of the imaging unit 2. By adjusting the distance between the subject and the terminal device 100 to an appropriate distance, the person taking the measurement can measure the subject's biological information. The second indicator image 52 may also be a figure (e.g., an X mark) indicating the center of the subject's face when the subject's face is aligned to a predetermined position on the display unit 4 screen, or a figure indicating the positions of the eyes, nose, mouth, ears, etc.

[0024] The frame-shaped guide may have an isotropic shape. Examples of isotropic shapes include, but are not limited to, a circle, a regular polygon, or a sphere.

[0025] Furthermore, the display control unit 17 may superimpose a notification image 61 on the display image, indicating notification information related to the measurement for the person taking the measurement, based on the measurement-related situation identified by the situation identification unit 16 (see Figures 2 to 9). The display control unit 17 may also superimpose a measurement result image 62 on the display image, indicating the biological information items of the target to be measured by the measurement unit 12 and the measurement results (see Figures 2, 3, 8, and 9).

[0026] Alternatively, instead of the display control unit 17 displaying the notification image 61, a speaker provided in the terminal device 100 may output notification information related to the measurement to the person taking the measurement in voice. Similarly, instead of the display control unit 17 displaying the measurement result image 62, a speaker provided in the terminal device 100 may output the items of the biological information of the subject being measured and the measurement result in voice.

[0027] (2. Method of displaying the first index image 51 and the second index image 52) Next, referring to Figures 2 to 9, the detailed display method of the first indicator image 51 and the second indicator image 52 by the display control unit 17 will be described below. In the example shown in Figures 2 to 9, the second indicator image 52 is a circular frame-shaped guide with an isotropic shape, and the first indicator image 51 is a human-shaped contour guide.

[0028] Furthermore, in one example shown in Figures 2 to 9, the display control unit 17 displays the notification image 61 at the top of the display unit 4 screen and the measurement result image 62 at the bottom of the display unit 4 screen while the display image is being shown. However, the position and timing of the display control unit 17 displaying the notification image 61 and the measurement result image 62 are not limited to this. For example, the notification image 61 and the measurement result image 62 may be displayed on the left and right sides of the display unit 4 screen. The measurement result image 62 may be displayed after the measurement is completed. Also, for convenience, the measurement result image 62 is omitted from the illustration in Figures 4 to 7.

[0029] Figure 2 shows an example of an image displayed by the terminal device when measuring a subject in a seated or standing position. Figure 2 shows an example of display images P201 to P204 displayed by the display control unit 17 to remind the measurer to properly photograph the subject in a seated position.

[0030] Display image P201 shows the image displayed by the display control unit 17 at the start of shooting. Here, the display control unit 17 displays the second indicator image 52 at a predetermined position on the screen of the display unit 4. The predetermined position is, for example, approximately in the center of the area on the screen of the display unit 4, excluding the notification image 61 and the measurement result image 62. The display control unit 17 also displays notification information in the notification image 61, instructing the subject to place their face within the frame of the second indicator image 52 (the text "Please place your face within the frame").

[0031] Furthermore, the display control unit 17 displays a list of the biological information items ("body temperature," "blood pressure," "pulse," and "respiration") to be measured in the measurement result image 62. The result display area in the measurement result image 62 remains blank until the measurement is complete. The person taking the measurement checks this display image P201 and adjusts the shooting area by moving the terminal device 100 so that the subject's face is within the frame of the second indicator image 52.

[0032] Displayed image P202 shows the state in which the subject's face is within the frame of the second indicator image 52 after adjustment by the measurer. Here, the tilt detection unit 13 detects the tilt of the subject's face (which is within the frame of the second indicator image 52) in displayed image P202. At the same time, the measurement unit 12 starts measuring the subject's biological information.

[0033] Display image P203 shows the image displayed by the display control unit 17 after the start of measurement of biological information. Here, the display control unit 17 displays a first indicator image 51 that matches the tilt of the face detected by the tilt detection unit 13. That is, the display control unit 17 switches the second indicator image 52 to the first indicator image 51. As shown in Figure 2, when the person being measured is seated, the tilt of the person's face is aligned with the vertical direction on the screen of the display unit 4. Therefore, the first indicator image 51 is positioned so that the shoulder portion is directly below the face, left and right. Symmetry It serves as a guide for the outline of a human figure facing forward.

[0034] Furthermore, the display control unit 17 displays notification information (the text "Measurement in progress") in the notification image 61 indicating that biological information is being measured. In addition, the display control unit 17 displays the measurement results in the result display field in the measurement result image 62, sequentially displaying the biological information items as they are measured. The display control unit 17 displays the display image P203 until the measurement of biological information is complete. The person taking the measurement checks this display image P203 and continues to take pictures without changing the position of the subject's face until the measurement of biological information is complete.

[0035] Display image P204 shows the image displayed by the display control unit 17 when the measurement of all items of the biological information being measured is complete. At this point, the display control unit 17 terminates the display of the first indicator image 51. The display control unit 17 also displays notification information (the text "Measurement complete") in the notification image 61 indicating that the measurement of all items of the biological information has been completed. The display control unit 17 also displays the measurement results of the measured biological information in the result display field of the measurement result image 62. The person performing the measurement recognizes that the measurement of the biological information has been completed by checking this display image P204.

[0036] As described above, the display control unit 17 can first start taking images so that the subject's face is within the frame of the second indicator image 52, and then instruct the user to continue taking images so that the face position does not shift in line with the first indicator image 51. This makes it possible to take images necessary for measuring biological information relatively easily by using the terminal device 100, even if the user is unfamiliar with devices such as smartphones.

[0037] Furthermore, the display control unit 17 displays the measurement results sequentially in the measurement result image 62, starting with the biological information that has been measured, allowing the user to confirm the progress. This makes the user perceive the measurement time as shorter compared to displaying the measurement results only after all biological information has been measured, thereby reducing the stress the user experiences while waiting for the measurement to be completed.

[0038] Furthermore, the display control unit 17 may display only the biological information that the measurement unit 12 can measure from the captured image, out of the predetermined biological information (biological information of the object to be measured), in the measurement result image 62. For example, to measure respiratory rate, the subject's shoulders must be visible in the captured image. If the subject's shoulders are not visible in the captured image, the measurement unit 12 will not measure the respiratory rate, even if the respiratory rate is included in the predetermined biological information.

[0039] In such cases, the situation identification unit 16 identifies the respiratory rate as a biological information that cannot be measured from the predetermined biological information. The display control unit 17 displays a list of biological information excluding the unmeasurable biological information in the measurement result image 62. This prevents the user from becoming confused by the presence of biological information (biological information items) whose measurement results are not displayed even after the measurement is complete. Furthermore, by reducing the number of items displayed in the list of biological information, it is expected that the user will perceive the measurement time as shorter.

[0040] Figure 3 shows an example of an image displayed by the terminal device 100 when measuring a subject in a lying-down position. Figure 3 shows an example of display images P301 to P304 displayed by the display control unit 17 to make the measurer aware of the importance of properly photographing the subject in a lying-down position.

[0041] Similar to the display images P201, P202, and P204 in Figure 2, the display control unit 17 displays display images P301, P302, and P304, respectively.

[0042] Furthermore, in the displayed image P303, the display control unit 17 displays a first indicator image 51 corresponding to the subject who is lying on their side. That is, as shown in Figure 3, when a subject lying on their side is photographed from diagonally above and to the right of the subject, the tilt of the subject's face will be tilted to the left with respect to the vertical direction on the display unit 4 screen. The tilt detection unit 13 detects this tilt of the subject's face. Therefore, the first indicator image 51 becomes a diagonally tilted human-shaped contour guide, with the shoulder portion located in the lower right of the face position facing diagonally upward to the right, and the left shoulder positioned higher than the right shoulder.

[0043] In this way, the display control unit 17 displays a first indicator image 51 that allows the operator to continue shooting without changing the position of the subject's face, in accordance with the tilt of the subject's face being photographed. In other words, if the face of a subject lying on their side is photographed at an angle to the screen, the display control unit 17 detects that the face is tilted at an angle and displays a first indicator image 51 that reflects the tilt of the face. This allows the operator to intuitively understand that there is no need to rotate the terminal device 100 to match the tilt of the subject's face while they are lying on their side, and that there is no need to point the terminal device 100 directly at the subject's face when shooting, and that it is fine to continue shooting in the current position.

[0044] Furthermore, by using the first indicator image 51 as a human-shaped contour guide including the face and shoulder areas, the measurer is encouraged to align the lines of the face and shoulders in the image being captured with the lines of the human-shaped contour guide displayed nearby, thereby ensuring that the subject's face position is not misaligned and that the terminal device is not moved. This makes it easier to capture images without misaligning (shifting) the face position.

[0045] Furthermore, the display of the second indicator image 52 before measurement begins allows the operator to start shooting without hesitation regarding the position of the subject's face within the displayed image. After measurement begins, the display of the first indicator image 51, which includes a human-shaped contour guide including the shoulder area, helps the operator to be mindful of not moving the subject's face and not moving the terminal device. This makes it easy to take photos without moving the face.

[0046] Furthermore, depending on the performance of the imaging unit 2, there may be constraints on the distance between the person being measured and the terminal device 100. Even in such cases, before starting the measurement, a frame-shaped guide as shown in Figures 2 and 3 can be displayed as a second indicator image 52, and the person being measured's face can be placed within the frame-shaped guide, making it easy to adjust the distance between the person being measured and the terminal device 100 to within the constraints. The measurement unit 12 may also start the measurement after a certain period of time has elapsed in which the difference between the size of the frame-shaped guide and the size of the face is smaller than a threshold.

[0047] Furthermore, if a directional frame-shaped guide, such as an ellipse or rectangle, is displayed, there is a concern that the person being measured may feel burdened or start the measurement in an awkward posture, as they will feel the need to align their face with the direction of the frame-shaped guide. In contrast, by using an isotropic frame-shaped guide, the person being measured can be made aware that all they need to do is place their face within the frame-shaped guide.

[0048] Display image P304 shows the image displayed by the display control unit 17 when the measurement of all items of the biological information being measured is complete. At this point, the display control unit 17 terminates the display of the first indicator image 51. The display control unit 17 also displays notification information (the text "Measurement complete") in notification image 61 indicating that the measurement of all items of the biological information has been completed. The display control unit 17 also displays the measurement results of the measured biological information in the result display field of measurement result image 62. The person performing the measurement recognizes that the measurement of the biological information has been completed by confirming this display image P304.

[0049] Figure 4 shows an image displayed by the terminal device 100 when measuring a subject whose face is turned to the side. Figure 4 shows an example of a display image P401 that the display control unit 17 displays when the orientation detection unit 14 determines, based on the face image, that the subject's face is turned to the side on the screen of the display unit 4.

[0050] In the displayed image P401, the display control unit 17 displays a first indicator image 51 to instruct the measurer to continue taking pictures without changing the face position of the subject whose face is turned to the side. Here, the first indicator image 51, which is a human-shaped contour guide, includes side-view feature parts (for example, a side-view nose or the shape of a side-view shoulder).

[0051] This allows the user to be aware that it is acceptable to continue photographing the profile of the face. Therefore, it is possible to avoid situations where the user moves the terminal device 100 in an attempt to forcibly photograph the front of the face, which could lead to measurement failure.

[0052] Figure 5 shows an example of an image displayed by the terminal device 100 when the position of the subject's face on the display unit 4 shifts within a predetermined range. Figure 5 shows an example of display images P501 to P503, in which the first indicator image 51 is displayed at the position that would be displayed if there was no shift in face position, without tracking the shift in the subject's face position on the display unit 4. Note that when the face position shifts, the shoulder position also shifts, but this will be referred to as "shift in face position" from here on.

[0053] Display image P501 shows the image displayed by the display control unit 17 when measurement of biological information begins. Here, the display control unit 17 displays a first indicator image 51 that is aligned with the tilt of the face detected by the tilt detection unit 13 and does not deviate from the position of the subject's face.

[0054] Display image P502 shows a state where the subject's face position has shifted relative to the subject's face position at the start of biological information measurement (shown in display image P501), for example, due to the measurer's hand tremor. Here, the display control unit 17 superimposes the first indicator image 51 onto the position that would be displayed if there were no shift in face position, so that the first indicator image 51 does not follow the shift in face position. Therefore, the first indicator image 51 is held at the position at the start of measurement, and in display image P502, the first indicator image 51 is shifted relative to the subject's face position.

[0055] Displayed image P503 shows a state where the subject's face position is further shifted relative to the subject's face position at the start of biometric data measurement compared to displayed image P502. In displayed image P503, the first index image 51 is further shifted relative to the subject's face position compared to displayed image P502.

[0056] In a configuration where the first indicator image 51 follows the shift in face position, there is a concern that some measurers may neglect to consciously try to keep the face position unchanged, that is, to avoid moving the terminal device 100 during shooting. On the other hand, as shown in Figure 5, by displaying the first indicator image 51 at the position shown when there is no shift in face position, it is possible to strongly make the measurer aware of any shift in face position.

[0057] Figure 6 shows another example of an image displayed by the terminal device 100 when the position of the subject's face on the display unit 4 screen shifts. Figure 6 shows an example of display images P601 to P603 in which the first indicator image 51 is made to track the change in the subject's face position on the display unit 4 screen. Note that the display that tracks the first indicator image 51 in response to changes in face position shall be performed only when the shift in face position is within a predetermined range. This predetermined range is, for example, the range in which predetermined biological information of the subject can be measured.

[0058] Display image P601 shows the image displayed by the display control unit 17 when measurement of biological information begins. Here, the display control unit 17 displays a first index image 51 that is aligned with the tilt of the face detected by the tilt detection unit 13 and does not deviate from the position of the subject's face.

[0059] Display image P602 shows a state where the subject's face position has shifted relative to the subject's face position at the start of biological information measurement (shown in display image P601), for example, due to the measurer's hand tremor. The shift in the subject's face position in display image P602 is within a predetermined range. Here, if the face position shift is within a predetermined range, the display control unit 17 superimposes and displays the first indicator image 51 on the display image, following the change in face position (change in the position of the face image). Therefore, in display image P602, the first indicator image 51 is not shifted relative to the subject's face position.

[0060] Displayed image P603 shows a state where the subject's face position is further shifted from the subject's face position at the start of biometric data measurement compared to displayed image P602. The shift in the subject's face position in displayed image P603 is within a predetermined range. Because the first index image 51 is displayed in accordance with the changes in the face image, the first index image 51 is not shifted relative to the subject in displayed image P603 either.

[0061] In a configuration where the first indicator image 51 is displayed at a position that is not affected by facial position shift, some users may become concerned about facial position shifts and move the terminal device significantly, potentially preventing the acquisition of information necessary for measuring biometric data. For example, pulse rate measurement requires continuous changes, but if the facial image changes significantly, continuous changes cannot be acquired. In such cases, displaying the image in accordance with the changes in facial position, as described above, can reduce measurement failures caused by moving the terminal device 100. Furthermore, displaying the image in accordance with the changes in facial position allows the user to recognize that there are no problems with the image capture and that the measurement is progressing, thus providing reassurance.

[0062] Figure 7 shows the image that the terminal device 100 displays when the size of the subject's face on the display unit 4 screen falls below a predetermined threshold. Figure 7 shows an example of display images P701 to P703, in which the size of the first indicator image 51 is set to a predetermined minimum size when the size of the subject's face on the display unit 4 screen falls below a predetermined threshold.

[0063] Display image P701 shows the image displayed by the display control unit 17 when measurement of biological information begins. Here, the display control unit 17 displays a first index image 51 that matches the size of the subject's face as detected by the size detection unit 15. Display image P702 shows a state where the size of the subject's face has decreased compared to the size of the subject's face at the start of biological information measurement (shown in display image P701). The size of the subject's face in display image P702 is above a predetermined threshold. Here, if the size of the subject's face is above a predetermined threshold, the display control unit 17 adjusts the size of the first indicator image 51 (human-shaped contour guide) to match the size of the subject's face in the display image and displays it accordingly. Therefore, from display image P701 to display image P702, the first indicator image 51 follows the size of the subject's face.

[0064] Display image P703 shows a state where the size of the subject's face has become even smaller than the size of the subject's face at the start of biological information measurement compared to display image P702. The size of the subject's face in display image P703 is smaller than a predetermined threshold. Here, the display control unit 17 displays the first indicator image 51 (human-shaped contour guide) at a predetermined minimum size when the size of the subject's face is smaller than a predetermined threshold. In display image P703, the first indicator image 51 does not follow the size of the subject's face and maintains a predetermined minimum size.

[0065] If the distance between the terminal device 100 and the person being measured is large, and the size of the person's face in the captured image is small, there is a possibility that the measurement of biological information will fail. Therefore, it is necessary to prevent the size of the person's face in the captured image from becoming too small. To this end, the display control unit 17 fixes the size of the first indicator image 51 to a predetermined minimum size if the size of the person's face is smaller than a predetermined threshold, and displays the first indicator image 51 so that it does not become smaller than the predetermined minimum size. This makes the person being measured aware that the size of the person's face on the screen of the display unit 4 must not be smaller than a predetermined threshold (i.e., the distance between the terminal device 100 and the person being measured must be kept appropriate).

[0066] Figure 8 shows an example of an image displayed by the terminal device 100 when the status identification unit 16 identifies a measurement failure. Figure 8 shows an example of display images P801 to P804, which indicate the state in which the display control unit 17 continues to display the first indicator image 51 when the status identification unit 16 identifies a measurement failure.

[0067] Display image P801 is the same as display image P501 shown in Figure 5. At this point, the display control unit 17 displays the completed body temperature measurement result in the measurement result image 62.

[0068] Display image P802, similar to display image P502 shown in Figure 5, shows the state where the first indicator image 51 is displayed in the position shown when there is no shift in the subject's face position, without following the shift in the subject's face position. At this point, the display control unit 17 displays the measurement results of body temperature and blood pressure, which have been measured, in the measurement result image 62.

[0069] Display image P803 indicates a state where the subject's face position has shifted beyond a predetermined range. At this time, the situation identification unit 16 identifies a measurement failure in the measurement unit 12. Here, the display control unit 17, while displaying the first indicator image 51, continues to display the first indicator image 51 once the situation identification unit 16 identifies a measurement failure. In other words, even if the subject's face position shifts beyond a predetermined range and remeasurement is required, the first indicator image 51 continues to be displayed in the position that would be displayed if there were no face position shift.

[0070] Furthermore, when the status identification unit 16 identifies a measurement failure, the display control unit 17 displays notification information (the text "We will measure again") in the notification image 61 indicating that a remeasurement will be performed. The display control unit 17 also terminates the display of the body temperature and blood pressure measurement results in the measurement result image 62. The person taking the measurement confirms this display image P803 and operates the terminal device 100 to return to the face portion of the first indicator image 51, which continues to display the face of the person being measured.

[0071] Displayed image P804 shows the state where the subject's face has returned to the face portion of the first indicator image 51 due to the operator's actions. When the subject's face returns to the face portion of the first indicator image 51, the measurement unit 12 resumes measuring the subject's biological information.

[0072] As described above, by continuing to display the first indicator image 51 even if the measurement fails, the user is prompted to remeasure, and the remeasurement can be started quickly. Some users may become confused or bewildered when the first indicator image 51 disappears. For such users, continuing to display the first indicator image 51 allows them to quickly perform a remeasurement.

[0073] Figure 9 shows another example of an image displayed by the terminal device 100 when the status identification unit 16 identifies a measurement failure. Figure 9 shows an example of display images P901 to P904, in which the display of the first indicator image 51 is terminated and the second indicator image 52 is displayed when the status identification unit 16 identifies a measurement failure.

[0074] Display images P901 and P902 show the same state as display images P801 and P802, respectively.

[0075] Display image P903 indicates that the subject's face position has shifted beyond a predetermined range. At this time, the situation identification unit 16 identifies a measurement failure in the measurement unit 12. Here, the display control unit 17, while displaying the first indicator image 51, terminates the display of the first indicator image 51 and displays the second indicator image 52 when the situation identification unit 16 identifies a measurement failure. In other words, if the subject's face position shifts beyond a predetermined range, the display switches from the first indicator image 51 to the second indicator image 52. The notification image 61 and the measurement result image 62 are displayed in the same way as display image P803. The person taking the measurement checks this display image P903 and moves the terminal device 100 to return the face portion to the frame of the second indicator image 52, which is displayed again.

[0076] When the operator moves the terminal device 100 so that the subject's face is returned to the frame of the second indicator image 52, the tilt detection unit 13 detects the tilt of the subject's face (which has returned to the frame of the second indicator image 52) in the displayed image P903, and the measurement unit 12 resumes measuring the subject's biological information.

[0077] Display image P904 shows the image displayed by the display control unit 17 when the measurement of biological information is resumed. Here, the display control unit 17 displays a new first indicator image 51 according to the tilt of the face detected by the tilt detection unit 13.

[0078] As described above, if a measurement fails, the display returns to the second indicator image, and the operator is made aware that a remeasurement has started. This helps to motivate the operator to avoid making the same mistake next time.

[0079] Figure 10 shows an example of an image displayed by the terminal device 100 when the position of the subject's face on the display unit 4 screen shifts beyond a predetermined range. Figure 10 shows an example of display images P1001 to P1004, in which the first indicator image, which had been tracking the change in the face image, quickly returns to its original position at the start of measurement when the face image shifts beyond a predetermined range. Display image P1001 shows the same state as display image P601.

[0080] Display image P1002 shows a state where the subject's face position has shifted relative to the subject's face position at the start of biological information measurement (shown in display image P1001). Note that the shift in the subject's face position in display image P1002 is within a predetermined range. When the face position shift is within a predetermined range, the display control unit 17 superimposes the first indicator image 51 onto the display image, following the change in face position. Therefore, in display image P1002, the first indicator image 51 is not shifted relative to the subject's face position.

[0081] Displayed image P1003 shows a state where the subject's face position is further shifted from the subject's face position at the start of biological information measurement compared to displayed image P1002. Note that the shift in the subject's face position in displayed image P1003 is within a predetermined range. In displayed image P1003, the first index image 51 is not shifted relative to the subject's face position.

[0082] Display image P1004 shows a state in which the subject's face position has shifted beyond a predetermined range from the subject's face position at the start of biological information measurement. When the shift in face position exceeds the predetermined range, the display control unit 17 displays the first indicator image 51 at a speed faster than the change in face position, in the position that would be displayed if there were no shift (in the direction of the first indicator image 51 displayed at the start of biological information measurement). In the example shown in Figure 10, since the face position has shifted upward, the display control unit 17 shows the movement of the first indicator image as it moves rapidly downward.

[0083] The display control unit 17 displays the first indicator image 51 with a movement that returns it at high speed to the position it would be displayed in if there were no displacement, when the amount of face position displacement exceeds a predetermined range. In other words, the terminal device 100 not only makes the first indicator image 51 follow the face position, but also makes it move in a way that is faster than the change in face position, causing it to bounce, thereby making the person taking the measurement strongly aware that their face position is shifted.

[0084] (3. Example of operation) Figure 11 is a flowchart illustrating an example of the operation of the terminal device 100. An example of the operation by which the terminal device 100 appropriately measures the biological information of the person being measured will be described below with reference to Figure 11.

[0085] First, triggered by an input operation by the measurer via the input unit 3, for example, the imaging unit 2 starts imaging. When imaging starts, the display control unit 17 displays the second indicator image 52 at a predetermined position on the screen of the display unit 4 (S11). Next, when the measurer adjusts the imaging area and the subject's face enters the frame of the second indicator image 52, the information acquisition unit 11 starts acquiring the image of the subject as information for measuring the subject's biological information (S12). Next, the tilt detection unit 13 detects the tilt of the subject's face on the screen of the display unit 4 based on the face image of the subject included in the image (S13). Next, the measurement unit 12 starts measuring the subject's biological information based on the image (S14).

[0086] Next, the display control unit 17 overlays and displays a first indicator image 51, which matches the tilt of the face detected by the tilt detection unit 13, onto the display image (S15). When the first indicator image 51 is displayed, the display control unit 17 disables the function that automatically switches the vertical and horizontal display direction of the display image on the screen of the display unit 4 (S16). If, during measurement by the measurement unit 12, the position of the subject's face on the screen of the display unit 4 does not shift beyond a predetermined range, the measurement unit 12 terminates the measurement of the subject's biological information (S17). At this time, the display control unit 17 changes the display format of the screen of the display unit 4 so that the person being measured can understand that the measurement has ended (see Figure 12). If, during measurement by the measurement unit 12, the position of the subject's face on the screen of the display unit 4 shifts beyond a predetermined range, the system returns to S11 (corresponding to the pattern in Figure 9) or S15 (corresponding to the pattern in Figure 8). Once the measurement is complete, the information acquisition unit 11 terminates the acquisition of the captured image as information.

[0087] Next, the display control unit 17 terminates the display of the first indicator image 51 and enables the function to automatically switch the display orientation of the displayed image vertically or horizontally on the screen of the display unit 4 (S18).

[0088] Thus, while the first indicator image 51 is displayed, the display control unit 17 disables the function that automatically switches the display orientation of the displayed image on the screen of the display unit 4. If, during shooting, the function that automatically switches the display orientation based on the tilt of the terminal device 100 is activated and the display orientation switches, there is a risk that the terminal device 100 may be moved in a panic, leading to a measurement failure. By disabling the automatic switching function while the first indicator image 51 is displayed, the failure of measurement due to moving the terminal device 100 can be reduced. The display control unit 17 may also disable the automatic switching function at a point before S11.

[0089] (4. Example of display at the end of measurement) Figure 12 shows an image displayed by the terminal device 100 based on the completion of the measurement of the subject's biological information. The status identification unit 16 identifies that the measurement of the subject's biological information has been completed in the measurement unit 12. Based on the identification by the status identification unit 16, the display control unit 17 changes the display format of the display unit 4 so that the person taking the measurement can understand that the measurement has been completed.

[0090] Figure 12 shows examples of display images P1201 and P1202, which are displayed in a frontal orientation on the screen of the display unit 4 when the measurement of the subject's biological information is completed. Display image P1201 shows the same state as display image P303.

[0091] Display image P1202 shows the image displayed by the display control unit 17 after the measurement of the subject's biological information is completed. Here, based on the identification by the status identification unit 16, the display control unit 17 displays the screen of the display unit 4 facing the user so that the user can understand that the measurement is complete. In other words, the display control unit 17 rotates the displayed image so that the tilt of the face is aligned with the vertical direction on the screen of the display unit 4. The display control unit 17 may also display the process of the displayed image rotating during this process. This allows the terminal device 100 to intuitively inform the user that it is OK to end the shooting of the subject.

[0092] Furthermore, the display control unit 17 may terminate the display of the first indicator image 51 so that the user can understand that the measurement has been completed. Also, regardless of whether the screen of the display unit 4 is facing directly, the display control unit 17 may display the completed biological information in a larger size, including as shown in other display examples.

[0093] Furthermore, regardless of whether the screen of the display unit 4 is facing directly, and including as shown in other display examples, the display control unit 17 may switch the display mode of the screen of the display unit 4 from video to a still image after the measurement is completed if it is displaying video during the measurement.

[0094] Figure 13 shows the gradual change from the second indicator image 52 to the first indicator image 51. As shown in Figure 13, when the display control unit 17 switches from the second indicator image 52 to the first indicator image 51, it may gradually change from the second indicator image 52 (figure m1), which is a circular frame-shaped guide, to the first indicator image 51 (figure m8), which is a human-shaped contour guide. Then, the screen of the display unit 4 should display the portion of the human-shaped contour guide that corresponds to the size of the captured image.

[0095] In this way, by transitioning smoothly from the second indicator image 52 to the first indicator image 51, which is aligned with the tilt of the subject's face, the measurer can be made aware that it is possible to take an appropriate image in the current state.

[0096] As explained above, the terminal device 100 according to this embodiment can contribute to Sustainable Development Goal (SDG) 3, "Ensure healthy lives and promote well-being for all." This contributes to achieving the Sustainable Development Goals (SDGs).

[0097] [Examples of implementation using software] The function of the terminal device 100 (hereinafter referred to as "device") is a program that causes the device to function as a computer, and can be realized by a program that causes each control block of the device (in particular each part included in the control unit 1) to function as a computer.

[0098] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., memory) as hardware for executing the program. By executing the program using this control device and storage device, the functions described in each of the embodiments are realized.

[0099] The above program may be recorded on one or more computer-readable recording media, not temporary ones. These recording media may or may not be provided by the above device. In the latter case, the program may be supplied to the above device via any wired or wireless transmission medium.

[0100] Furthermore, some or all of the functions of each of the above control blocks can also be realized by logic circuits. For example, an integrated circuit in which logic circuits functioning as each of the above control blocks are formed is also included in the scope of the present invention. In addition, it is also possible to realize the functions of each of the above control blocks by, for example, a quantum computer.

[0101] Furthermore, each process described in the above embodiments may be performed by AI (Artificial Intelligence). In this case, the AI ​​may operate on the control device described above, or it may operate on other devices (for example, an edge computer or a cloud server).

[0102] 〔summary〕 A terminal device according to embodiment 1 of the present invention comprises: an imaging unit; a display unit; an information acquisition unit that acquires an image of a person to be measured taken by the imaging unit as information for measuring the biological information of the person to be measured; a tilt detection unit that detects the tilt of the person to be measured on the screen of the display unit based on the face image of the person to be measured included in the image taken by the imaging unit; and a display control unit that superimposes a first index image, which matches the tilt of the face detected by the tilt detection unit, onto an image including the person to be measured that is displayed on the screen of the display unit.

[0103] In conventional configurations where the face position guide for aligning with the subject's face is fixed, the person taking the measurement needs to rotate the terminal device to match the face position guide. This raises concerns that the person taking the measurement may find this inconvenient, especially if the subject is lying down.

[0104] According to the above configuration, the display control unit displays the first index image in accordance with the tilt of the subject's face as captured. In other words, if the face of a subject lying on their side is photographed at an angle to the screen, the unit detects that the face is tilted at an angle and displays the first index image with the face tilted at an angle. Therefore, the person taking the measurement can start by taking a picture so that the subject's face is in the frame, and then continue taking pictures so that the face position does not shift in accordance with the superimposed first index image, thereby capturing the images necessary to measure biological information.

[0105] The first indicator image according to aspect 2 of the present invention may be a human-shaped contour guide including the face and shoulder portions in aspect 1.

[0106] The above configuration allows the operator to be mindful of not moving the subject's face and not moving the terminal device. This makes it easy to take images without moving (shifting) the subject's face.

[0107] In the display control unit according to embodiment 3 of the present invention, in embodiment 1, a second indicator image, which is an indicator for the measurer to align the face position of the person to be measured to a predetermined position on the screen, may be superimposed on the image before the start of measurement, and a first indicator image, which is a human-shaped contour guide including the face and shoulder portions, may be superimposed on the image after the start of measurement.

[0108] With the above configuration, the display of the second indicator image before measurement begins allows the operator to start shooting without hesitation regarding the position of the subject's face within the captured image. After measurement begins, the display of the first indicator image, which is a human-shaped contour guide including the shoulder area, helps the operator to be mindful of not moving the subject's face and not moving the terminal device. This makes it easy to take images without moving the face.

[0109] The second indicator image according to aspect 4 of the present invention may be a frame-shaped guide in aspect 3 that causes the face of the person being measured, as displayed on the screen, to be positioned inside.

[0110] Depending on the performance of the imaging unit, there may be restrictions on the distance between the subject and the terminal device. Even in such cases, by displaying a frame-shaped guide as a second indicator image before starting the measurement and ensuring the subject's face is within the frame-shaped guide, the distance between the subject and the terminal device can be easily adjusted to stay within the constraints.

[0111] The frame-shaped guide according to aspect 5 of the present invention may have an isotropic shape in aspect 4 described above.

[0112] If a directional frame-shaped guide, such as an ellipse or rectangle, is displayed, there is a concern that the user may feel burdened by the need to align their face with the direction of the frame-shaped guide.

[0113] By using an isotropic, frame-shaped guide, it is possible to make the person taking the measurement aware that all they need to do is place their face within the frame guide.

[0114] The isotropic shape according to aspect 6 of the present invention may be a circle, a regular polygon, or a sphere in aspect 5 described above.

[0115] In the display control unit according to embodiment 7 of the present invention, the first indicator image may be superimposed on the image at a position that is displayed when there is no displacement of the face position of the person being measured, as in embodiments 1 to 6 above.

[0116] In a configuration where the first indicator image tracks the shift in face position, there is a concern that some users may neglect to consciously try to keep the face position still, i.e., not move the terminal device, when taking the image. By displaying the first indicator image at the position where it would normally appear if there were no face position shift, it is possible to strongly make the user aware of any face position shift.

[0117] In the display control unit according to embodiment 8 of the present invention, if the displacement of the face position of the person being measured is within a predetermined range, the first indicator image may be superimposed on the image and displayed in accordance with the change in the face position.

[0118] In a configuration where the first indicator image is displayed at a position that is only visible when there is no facial position shift, some users may become concerned about facial position shifts and move the terminal device significantly, potentially resulting in the inability to acquire the information necessary for measuring biological data (for example, the continuous changes required for measuring pulse rate) (i.e., measurement failure). In contrast, by displaying the image in accordance with changes in facial position, as described above, measurement failures caused by moving the terminal device can be reduced. Furthermore, displaying the image in accordance with changes in facial position allows the user to recognize that there are no problems with the image capture and that the measurement is progressing, thus providing reassurance.

[0119] In the display control unit according to aspect 9 of the present invention, in aspects 1 to 8 described above, the function of automatically switching the vertical and horizontal display orientation of the image on the screen while the first indicator image is being displayed may be disabled.

[0120] If, during shooting, the automatic display orientation switching function based on the tilt of the terminal device is activated and the display orientation changes, there is a risk of panicking and moving the terminal device, leading to measurement failure. By disabling the automatic switching function while the first indicator image is displayed, measurement failures caused by moving the terminal device can be reduced.

[0121] A terminal device according to embodiment 10 of the present invention, in embodiment 2 or 3 above, is provided with a orientation detection unit that detects whether the face of the person being measured is facing sideways based on the face image of the person being measured included in the image being captured by the imaging unit, and if the face of the person being measured is facing sideways, the first indicator image, which is the human-shaped contour guide, may include sideways characteristic portions.

[0122] With the above configuration, if the subject's face is turned to the side, the first indicator image, a human-shaped contour guide, includes sideways features, such as the sideways shape of the nose and shoulders. This allows the subject to be aware that it is acceptable to continue photographing their profile. This prevents the subject from moving the terminal device in an attempt to forcibly photograph the front of the face, which could lead to measurement failure.

[0123] A terminal device according to embodiment 11 of the present invention, in embodiment 2 or 3 above, includes a size detection unit that detects the size of the face of the person to be measured on the screen of the display unit based on the face image of the person to be measured included in the image being captured by the imaging unit, and the display control unit may, if the size of the face of the person to be measured is greater than or equal to a predetermined threshold, display the size of the human-shaped contour guide to match the size of the face of the person to be measured in the image, and if the size of the face of the person to be measured is less than the predetermined threshold, display the human-shaped contour guide at a predetermined minimum size.

[0124] If the distance between the terminal device and the person being measured is large, and the size of the person's face in the captured image is small, there is a possibility that the measurement of biometric information will fail. Therefore, it is necessary to prevent the size of the person's face in the captured image from being too small.

[0125] Therefore, if the size of the subject's face is smaller than a predetermined threshold, the display control unit fixes the size of the first indicator image to a predetermined minimum size and displays it in such a way that the first indicator image does not become smaller than the predetermined minimum size. This makes the person taking the measurement aware that the size of the subject's face on the display screen must not be smaller than a predetermined threshold (i.e., the distance between the terminal device and the subject must be kept appropriate).

[0126] The terminal device according to embodiment 12 of the present invention includes a situation identification unit that identifies the situation related to measurement, and the display control unit may continue to display the first indicator image when the situation identification unit identifies a measurement failure while the first indicator image is being displayed.

[0127] With the above configuration, even if a measurement fails, the first indicator image is displayed, allowing the operator to continue taking images and enabling a quick re-measurement.

[0128] The terminal device according to embodiment 13 of the present invention includes a situation identification unit that identifies the situation related to measurement, and the display control unit may, while displaying the first indicator image, terminate the display of the first indicator image and display the second indicator image when the situation identification unit identifies a measurement failure.

[0129] With the above configuration, if a measurement fails, the display returns to the second indicator image, and the operator is notified that a remeasurement has started, thereby encouraging the operator to be more confident in their ability to avoid failure next time.

[0130] Each aspect of the present invention may be implemented by a computer, in which case a control program for the terminal device that enables the computer to implement the terminal device by operating the computer as each part (software element) of the terminal device, and a computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention.

[0131] The present invention is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment. [Explanation of symbols]

[0132] 1 Control Unit 2. Photography Department 4 Display 11 Information acquisition department 13 Tilt detection unit 14 Direction detection unit 15. Size detection unit 16. Situation Identification Department 17 Display Control Unit 51. First Index Image 52 Second Index Image 100 terminal devices

Claims

1. The photography department, Display unit and An information acquisition unit acquires an image of the subject taken by the aforementioned imaging unit as information for measuring the subject's biological information, A tilt detection unit detects the tilt of the subject's face on the display unit's screen based on the subject's face image included in the image captured by the aforementioned imaging unit. A terminal device comprising: a display control unit that superimposes a first indicator image, which matches the tilt of the face detected by the tilt detection unit, onto an image including the person being measured, which is displayed on the screen of the display unit.

2. The terminal device according to claim 1, wherein the first indicator image is a human-shaped contour guide including the face and shoulders.

3. The display control unit, Before the measurement begins, a second indicator image, which is an indicator for the measurer to align the face position of the person being measured with a predetermined position on the screen, is superimposed on the image and displayed. The terminal device according to claim 1, wherein, after the start of measurement, the first indicator image, which is a human-shaped contour guide including the face and shoulders, is superimposed on the image and displayed.

4. The terminal device according to claim 3, wherein the second indicator image is a frame-shaped guide that causes the face of the person to be measured, as displayed on the screen, to be positioned inside.

5. The terminal device according to claim 4, wherein the frame-shaped guide has an isotropic shape.

6. The terminal device according to claim 5, wherein the isotropic shape is a circle, a regular polygon, or a sphere.

7. The terminal device according to any one of claims 1 to 6, wherein the display control unit displays the first indicator image superimposed on the image at a position that is displayed when there is no displacement in the face position of the person being measured.

8. The terminal device according to any one of claims 1 to 6, wherein the display control unit displays the first indicator image superimposed on the image in accordance with the change in the face position when the displacement of the face position of the person being measured is within a predetermined range.

9. The terminal device according to claim 1, wherein the display control unit disables the function of automatically switching the vertical and horizontal display orientation of the image on the screen while the first indicator image is being displayed.

10. The camera unit includes a direction detection unit that detects whether the subject's face is facing sideways based on the subject's face image included in the image being captured by the camera unit. The terminal device according to claim 2 or 3, wherein, when the face of the person being measured is turned to the side, the first indicator image, which is the human-shaped contour guide, includes a sideways characteristic portion.

11. The camera unit includes a size detection unit that detects the size of the subject's face on the display unit's screen based on the subject's face image included in the image being captured by the camera unit. The display control unit, If the size of the subject's face is greater than or equal to a predetermined threshold, the size of the human-shaped contour guide is displayed to follow the size of the subject's face in the image. The terminal device according to claim 2 or 3, which displays the human-shaped contour guide at a predetermined minimum size when the size of the subject's face is smaller than a predetermined threshold.

12. It is equipped with a situation identification unit that identifies the circumstances related to the measurement, The terminal device according to claim 1, wherein the display control unit continues to display the first indicator image when the status identification unit identifies a measurement failure while the display control unit is displaying the first indicator image.

13. It is equipped with a situation identification unit that identifies the circumstances related to the measurement, The terminal device according to any one of claims 3 to 6, wherein, while the display control unit is displaying the first indicator image, if the status identification unit identifies a measurement failure, the display control unit terminates the display of the first indicator image and displays the second indicator image.

14. A program for causing a computer to function as the terminal device described in claim 1, the program for causing the computer to function as the information acquisition unit, the tilt detection unit, and the display control unit.

Images