Display device and display method

Abstract

To reduce a user's sense of discomfort when rotating a display object on a display.SOLUTION: A display unit comprises: a display; a face angle detection unit that detects a face angle being an angle between the display and the face of a user; a line of sight and eyelid opening and closing detection unit that detects at least one of the user's line of sight and eyelid opening and closing motion; and a display control unit that adjusts a display angle of a display object by rotating the display object centered on a reference position of the display according to a result of detection of the face angle, determines whether the user is in a predetermined non-visual recognition state based on at least one of the user's line of sight and eyelid opening and closing motion, and when determining that the user is in the non-visual recognition state, does not rotate the display object.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a display device and a display method. [Background technology]

[0002] BACKGROUND ART Display devices that rotate a display object according to the angle between a display unit and a user's face are known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-167010 Summary of the Invention [Problem to be solved by the invention]

[0004] In the display device described in Patent Document 1, the displayed object may rotate when the user is not looking at the display unit, for example, when the user has their eyes closed or when the user is looking away from the display unit, which may cause the user to feel uncomfortable.

[0005] The present invention has been made in consideration of the above, and aims to provide a display device and a display method that can reduce the sense of discomfort felt by the user when rotating the display object on the display unit. [Means for solving the problem]

[0006] The display device of the present invention comprises a display unit, a face angle detection unit that detects a face angle, which is the angle between the display unit and the user's face, a gaze / eyelid opening / closing detection unit that detects at least one of the user's gaze and eyelid opening / closing movement, and a display control unit that adjusts the display angle of the display object by rotating the display object around a reference position of the display unit in accordance with the face angle detection result, determines whether the user is in a predetermined non-visual state based on at least one of the user's gaze and eyelid opening / closing movement, and prevents the display object from rotating if it is determined that the user is in the non-visual state.

[0007] The display method of the present invention includes detecting a face angle, which is the angle between a display unit and a user's face, detecting at least one of the user's line of sight and eyelid opening / closing movement, adjusting the display angle of the display object by rotating the display object around a reference position of the display unit in accordance with the detection result of the face angle, determining whether the user is in a predetermined non-visual state based on at least one of the user's line of sight and eyelid opening / closing movement, and not rotating the display object if it is determined that the user is in the non-visual state. [Effects of the Invention]

[0008] According to the present invention, it is possible to reduce the sense of discomfort felt by the user when rotating a display object on a display unit. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a display device according to a first embodiment. [Figure 2] FIG. 2 is a functional block diagram illustrating an example of the display device according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of a display method according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a display method according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of a display method according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a display method according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a display method according to the first embodiment. [Figure 8] FIG. 8 is a flowchart showing the flow of operations of the display device according to the first embodiment. [Figure 9] FIG. 9 is a functional block diagram illustrating an example of a display device according to the second embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a display method according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a display method according to the second embodiment. [Figure 12] FIG. 12 is a diagram showing an example of a display method according to the second embodiment. [Figure 13] FIG. 13 is a diagram showing an example of the relationship between detection targets of the user's line of sight and eyelid opening / closing action, and the display control content when the detection targets are detected. [Figure 14] FIG. 14 is a flowchart showing the flow of operations of the display device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of a display device and a display method according to the present invention will be described with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments. Furthermore, the components in the following embodiments include those that are easily replaceable by those skilled in the art, or those that are substantially the same.

[0011] [First embodiment] Fig. 1 is a schematic diagram showing an example of a display device 100 according to the first embodiment. Fig. 2 is a functional block diagram showing an example of a display device 100 according to the first embodiment. As shown in Fig. 1, the display device 100 has a housing 10, a display unit 20, an imaging unit 30, and a control unit 40. The display device 100 may be, for example, a portable information terminal such as a smartphone or a tablet.

[0012] The housing 10 holds a display unit 20, an image capturing unit 30, and a control unit 40. The housing 10 may be provided with an acceleration sensor (not shown) that can detect, for example, the walking of the user.

[0013] The display unit 20 can display image information such as still images and videos, and text information such as characters. A display such as a liquid crystal panel is used as the display unit 20. A predetermined reference direction is set in the display unit 20 and is used when detecting a face angle, which will be described later. For example, if the display unit 20 is rectangular, the reference direction can be one of two perpendicular sides.

[0014] The photographing unit 30 is capable of photographing the face and eyes of the user. The photographing unit 30 may be, for example, a camera attached to the housing 10. The photographing unit 30 generates photographed data by photographing the face and eyes of the user. The photographing unit 30 transmits the generated photographed data to the control unit 40. A plurality of photographing units 30 may be provided.

[0015] The control unit 40 comprehensively controls the operation of the display device 100. The control unit 40 has a processing unit such as a CPU (Central Processing Unit) and a storage unit such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The control unit 40 has a face angle detection unit 41, a gaze detection unit 42, a display control unit 43, and a storage unit 44.

[0016] The face angle detection unit 41 detects the face angle, which is the angle between the display unit 20 and the user's face, based on the imaging data generated by the imaging unit 30. The face angle detection unit 41 detects the center line in the width direction within the range from the user's forehead to chin, for example, and detects the angle between the center line direction and the reference direction of the display unit 20 as the face angle. The face angle is a value indicating the relative angle between the reference direction of the display unit 20 and the center line direction of the user's face. The face angle is a value indicating the difference in rotational position around the central axis perpendicular to the display unit 20 (rolling direction). The face angle changes when at least one of the reference direction of the display unit 20 and the center line direction of the user's face changes. Note that the face angle detection unit 41 may use a line connecting the centers of the user's left and right eyes as the center line direction.

[0017] The gaze detection unit 42 detects the gaze of the user based on the photographed data generated by the photographing unit 30. The gaze detection unit 42 may be configured to detect the gaze based on, for example, the position of the user's pupil and the position of the corneal reflection, or may be configured to detect the gaze based on the position of the inner corner of the user's eye and the position of the iris.

[0018] The display control unit 43 controls the display operation on the display unit 20. The display control unit 43 adjusts the display angle of the display object by rotating the display object around a reference position of the display unit 20 according to the detection result of the face angle. For example, the display control unit 43 can rotate the display object when the face angle is equal to or greater than a threshold. When the user's line of sight is detected on the display unit 20, the display control unit 43 sets the position corresponding to the line of sight as the reference position.

[0019] The display control unit 43 determines whether the display object includes text information, and if it determines that the display object includes text information, determines whether the user's line of sight is on the display portion of the text information. If it determines that the user's line of sight is on the display portion of the text information, the display control unit 43 sets the center of the line of the text information where the line of sight is on as the reference position.

[0020] The display control unit 43 can adjust the size of the display object and rotate it so that all of the text information displayed on the display unit 20 immediately before the rotation is displayed. Furthermore, if part of the text information is enlarged and displayed on the display unit 20 immediately before the rotation, the display control unit 43 can adjust the size of the display object and rotate it so that the entire line of the text information is displayed.

[0021] The storage unit 44 stores various types of information. The storage unit 44 has storage such as a hard disk drive, a solid state drive, etc. Note that an external storage medium such as a removable disk may also be used as the storage unit 44.

[0022] The memory unit 44 stores a display program that causes the computer to execute the following processes: detecting the face angle, which is the angle between the display unit 20 and the user's face; detecting the user's line of sight; and adjusting the display angle of the display object by rotating the display object around a reference position on the display unit 20 according to the detection result of the face angle; and, when the user's line of sight is detected on the display unit 20, setting the position corresponding to the line of sight as the reference position.

[0023] Next, an example of a display method in the above-described display device 100 will be described. Figs. 3 to 7 are diagrams showing an example of a display method according to the first embodiment. As shown in Fig. 3, the display control unit 43 displays a display object 21 on the display unit 20. The user can view the display object 21 displayed on the display unit 20. The display object 21 includes, for example, image information P, text information T, etc.

[0024] The photographing unit 30 photographs the face and eyes of the user looking at the display unit 20. The photographing unit 30 generates photographic data of the user's face and eyes and transmits the data to the control unit 40. In the control unit 40, the face angle detection unit 41 detects the face angle of the user based on the photographic data. Furthermore, the gaze detection unit 42 detects the gaze of the user based on the photographic data.

[0025] For example, when a user changes from a sitting position to lying down while looking at the display unit 20 of the display device 100, the facial angle between the user and the display unit 20 may change. When the facial angle of the user detected by the facial angle detection unit 41 exceeds a threshold, the display control unit 43 adjusts the display angle of the display object. As shown in FIG. 4 , the display control unit 43 can, for example, set the center of image information P of the display object 21 as a reference position, rotate the display object 90° around the reference position, and enlarge and display the image information P. Note that when adjusting the display angle of the display object, the display control unit 43 is not limited to a configuration in which the rotation angle is 90°, and may set the rotation angle to an angle other than 90°, such as 30°, 60°, or 120°.

[0026] When the display object 21 includes text information T, the display control unit 43 may perform the following process. That is, the display control unit 43 determines whether the display object includes text information T, and if it determines that the display object includes text information T, it determines whether the user's gaze EP is present in the display portion of the text information. Then, when it determines that the user's gaze EP is present in the display portion of the text information, the display control unit 43 can rotate the display object 21 around the center of the line direction of the text information where the gaze EP is present, as shown in FIG. 5 . When multiple lines of text information are displayed, the display control unit 43 may set the reference position BP to a position shifted toward the next line relative to the line where the gaze EP is present. In this case, rotating the display object 21 allows more of the text information that the user is about to read to be displayed. Furthermore, the display control unit 43 may set the reference position BP to coincide with the gaze EP. Note that, regardless of whether the display object 21 includes text information T, the display control unit 43 may use the position on the display unit 20 where the user's gaze is present as the reference position when rotating the display object 21.

[0027] Furthermore, when rotating the display object 21, the display control unit 43 may adjust the size of the display object 21 so that all of the text information T displayed on the display unit 20 immediately before the rotation is displayed, as shown in Fig. 6. In this case, the reference position BP set during the rotation does not need to be located at the center of the display unit 20.

[0028] 7, when rotating the display object 21, the display control unit 43 determines whether or not a part of the text information T is being enlarged and displayed on the display unit 20 immediately before the rotation. If the display control unit 43 determines that a part of the text information T is being enlarged and displayed on the display unit 20, the display control unit 43 may adjust the size of the display object 21 so that the entire line of the text information T is displayed.

[0029] 8 is a flowchart showing the flow of operations of the display device 100 according to the first embodiment. As shown in Fig. 8, when a display object is displayed on the display unit 20, the face angle detection unit 41 detects the face angle between the display unit 20 and the face of the user (step S101). Furthermore, the gaze detection unit 42 detects the gaze of the user (step S102).

[0030] The display control unit 43 determines whether the face angle exceeds a threshold value (step S103), and if it determines that the face angle does not exceed the threshold value (No in step S103), it maintains the display angle of the display object (step S104).

[0031] On the other hand, if it is determined that the threshold value is exceeded (Yes in step S103), the display control unit 43 determines whether the display object includes text information displayed in a row direction (step S105). If it is determined that the display object includes text information displayed in a row direction (Yes in step S105), the display control unit 43 determines whether the user's line of sight is present in the display portion of the text information (step S106). If it is determined that the user's line of sight is present in the display portion of the text information (Yes in step S106), the display control unit 43 sets the center of the row direction of the text information where the line of sight is present as the reference position (step S107). If it is determined in step S105 that the display object does not include text information displayed in a row direction (No in step S105) or if it is determined in step S106 that the user's line of sight is not present in the display portion of the text information (No in step S106), the display control unit 43 sets a predetermined position as the reference position (step S109). After setting the reference position, the display control unit 43 rotates the display object around the reference position (step S108).

[0032] As described above, the display device 100 according to this embodiment includes a display unit 20, a face angle detection unit 41 that detects the face angle, which is the angle between the display unit 20 and the user's face, a gaze detection unit 42 that detects the user's gaze, and a display control unit 43 that adjusts the display angle of the display object by rotating the display object around a reference position of the display unit 20 in accordance with the detection result of the face angle, and that, when the user's gaze is detected on the display unit 20, sets the position corresponding to the gaze as the reference position.

[0033] In addition, the display method according to this embodiment includes detecting a face angle, which is the angle between the display unit 20 and the user's face, detecting the user's line of sight, and adjusting the display angle of the display object by rotating the display object around a reference position of the display unit 20 according to the detection result of the face angle, and when the user's line of sight is detected on the display unit 20, setting the position corresponding to the line of sight as the reference position.

[0034] According to this configuration, when rotating a display object on display unit 20, if the user's line of sight is detected on display unit 20, the display object is rotated using a position corresponding to the line of sight as a reference position. This makes it possible to display the part that the user was looking at immediately before the rotation in an appropriate position.

[0035] In the display device 100 according to this embodiment, the display control unit 43 determines whether the display object includes text information displayed in a line direction, and if it determines that the display object includes text information displayed in a line direction, determines whether the user's line of sight is on the displayed portion of the text information, and if it determines that the user's line of sight is on the displayed portion of the text information, sets the center of the line direction of the text information where the line of sight is on as the reference position. With this configuration, the part of the text information that the user was looking at immediately before the rotation can be displayed in an appropriate position.

[0036] In the display device 100 according to this embodiment, the display control unit 43 adjusts the size of the display object and rotates it so that all of the text information displayed on the display unit 20 immediately before the rotation is displayed. This configuration can reduce the sense of discomfort felt by a user who is looking at the text information before and after the rotation.

[0037] In the display device 100 according to this embodiment, if a portion of the text information is enlarged and displayed on the display unit 20 immediately before the rotation, the display control unit 43 adjusts the size of the display object and rotates it so that the entire line of the text information is displayed. This configuration allows the user to grasp the entire line of the text information, including the portion they were looking at immediately before the rotation.

[0038] [Second embodiment] Fig. 9 is a functional block diagram showing an example of a display device 200 according to the second embodiment. As shown in Fig. 9, the display device 200 has a housing 10, a display unit 20, an image capturing unit 30, and a control unit 50. The configurations of the display unit 20 and the image capturing unit 30 in the housing 10 are the same as those of the display device 100 according to the first embodiment.

[0039] In this embodiment, the configuration of the control unit 50 is different from that of the control unit 40 of the display device 100 in the first embodiment. The following mainly describes the differences. The control unit 50 has a face angle detection unit 51, a gaze / eyelid opening / closing detection unit 52, a display control unit 53, and a storage unit 54. The face angle detection unit 51 is similar to the face angle detection unit 41 in the first embodiment.

[0040] The gaze / eyelid opening / closing detection unit 52 detects at least one of the user's gaze and eyelid opening / closing movement based on the photographed data generated by the photographing unit 30. The gaze / eyelid opening / closing detection unit 52 may be configured to detect the gaze based on the position of the user's pupil and the position of the corneal reflection, for example, or may be configured to detect the gaze based on the position of the user's inner corner of the eye and the position of the iris. The gaze / eyelid opening / closing detection unit 52 can also detect the movement of the user's eyelid based on image processing.

[0041] The display control unit 53 controls the display operation of the display unit 20. As in the first embodiment, the display control unit 53 adjusts the display angle of the display object by rotating the display object around the reference position of the display unit 20 in accordance with the detection result of the face angle. The display control unit 53 determines whether the user is in a predetermined non-viewing state based on at least one of the user's line of sight and eyelid opening / closing behavior, and does not rotate the display object if it determines that the user is in the non-viewing state. In this embodiment, the non-viewing state includes at least one of a state in which the user's eyelids are closed and a state in which the user's line of sight is not on the display unit 20. The display control unit 53 can determine that the user is in the non-viewing state, for example, when the line of sight / eyelid opening / closing detection unit 52 detects that the user has their eyelids closed. Furthermore, the display control unit 53 can determine that the user is in the non-viewing state, for example, when the line of sight / eyelid opening / closing detection unit 52 detects that the user's line of sight is in a direction away from the display unit 20. When it is detected that the non-viewing state has been resolved, the display control unit 53 adjusts the display angle of the display target based on the face angle at the time when the non-viewing state was resolved.

[0042] The display control unit 53 can at least one of set and change the initial value of the display angle of the display object according to the period during which the user's eyelids are closed. The initial value of the display angle is the display angle of the display object that is initially shown when the operation of the display device 200 is started or resumed.

[0043] The display control unit 53 can change the display mode of the display unit 20 based on at least one of the user's line of sight and eyelid opening / closing behavior. Examples of the user's line of sight include the position and displacement of the line of sight on the display unit 20. Examples of the user's eyelid opening / closing behavior include the period during which the user closes their eyelids and the number of blinks. Furthermore, if the display device 200 is provided with another component such as a sensor that can detect the user's walking, etc. by detecting acceleration, etc., the display control unit 53 can change the display mode by combining the other component such as the sensor with at least one of the user's line of sight and eyelid opening / closing behavior.

[0044] The storage unit 54 stores various types of information. The storage unit 54 has storage such as a hard disk drive, a solid state drive, etc. Note that an external storage medium such as a removable disk may also be used as the storage unit 54.

[0045] The memory unit 54 stores a display program that causes a computer to execute the following processes: detecting the face angle, which is the angle between the display unit 20 and the user's face; detecting at least one of the user's line of sight and eyelid opening / closing movement; adjusting the display angle of the display object by rotating the display object around a reference position of the display unit 20 according to the detection result of the face angle; determining whether the user is in a predetermined non-visual state based on at least one of the user's line of sight and eyelid opening / closing movement; and preventing the display object from rotating if it is determined that the user is in a non-visual state.

[0046] Next, an example of a display method in the above-described display device 200 will be described. Fig. 10 to Fig. 12 are diagrams showing an example of a display method according to the second embodiment. The display control unit 53 displays the display object 21 on the display unit 20. The user can see the display object 21 displayed on the display unit 20.

[0047] The photographing unit 30 photographs the face and eyes of a user looking at the display unit 20. The photographing unit 30 generates photographic data of the user's face and eyes and transmits the photographic data to the control unit 50. In the control unit 50, the face angle detection unit 51 detects the face angle of the user based on the photographic data. Furthermore, the gaze / eyelid opening / closing detection unit 52 detects the gaze or eyelid opening / closing action of the user based on the photographic data.

[0048] When the face angle of the user detected by the face angle detection unit 51 exceeds a threshold, the display control unit 53 adjusts the display angle of the display object. When the face angle changes, the display control unit 53 determines whether the user is in an inattentive state. When the display control unit 53 detects that the user's eyelids are open and that the user's line of sight is on the display unit 20, it determines that the user is not in an inattentive state. In this case, the display control unit 53 adjusts the display angle by rotating the display object 21 displayed on the display unit 20, as shown in FIG. 10 .

[0049] On the other hand, when it is detected that the user has their eyelids closed or when it is detected that the user's line of sight is not on the display unit 20, the display control unit 53 determines that the user is in a non-viewing state. In this case, the display control unit 53 prevents the display object 21 displayed on the display unit 20 from rotating, as shown in FIG. 11 . Thereafter, when it is detected that the user has opened their eyelids or when it is detected that the user's line of sight is on the display unit 20, the display control unit 53 determines that the user's non-viewing state has been resolved. In this case, as shown in FIG. 12 , the display control unit 53 adjusts the display angle of the display object 21 displayed on the display unit 20 based on the face angle at the time when it is determined that the non-viewing state has been resolved.

[0050] FIG. 13 is a diagram showing an example of the relationship between detection targets of the user's line of sight and eyelid opening / closing behavior and the display control content when the detection targets are detected. As shown in FIG. 13, the display control unit 53 can at least one of set and change the initial value of the display angle of the display target depending on the period during which the user keeps their eyelids closed. When the user's eyelid closing and then eyelid opening behavior is detected for a first period (e.g., one second), the display control unit 53 can set the display angle of the display target at the time the user opens their eyelids as the initial value of the display angle on the display unit 20. Furthermore, when the user sets the initial value of the display angle and then closes their eyelids for a second period (e.g., two seconds) and then eyelid opening behavior is detected, the display control unit 53 can cancel the setting of the initial value of the display angle.

[0051] 13, the display control unit 53 can change the display mode of the display unit 20 based on at least one of the user's line of sight and eyelid opening / closing action. For example, when the user's line of sight is detected at the upper part of the display unit 20 and a first number of blinking actions (e.g., two actions) are detected, the display control unit 53 can scroll the display object upward by half a screen of the display unit 20. When the user's line of sight is detected at the lower part of the display unit 20 and a first number of blinking actions (e.g., two actions) are detected, the display control unit 53 can scroll the display object downward by half a screen of the display unit 20.

[0052] 13, when the user's line of sight is detected at the top or bottom of the display unit 20, if a second number of blinking actions (e.g., three times) that is greater than the first number of blinking actions is detected, the display control unit 53 can scroll the display object up or down by one screen of the display unit 20. In this way, the display control unit 53 can set the direction in which the display object is scrolled based on the position of the line of sight on the display unit 20, and set the amount of scrolling based on the number of blinks.

[0053] 13, when the user's line of sight is detected at the top or bottom of the display unit 20, if blinking is detected the above-mentioned predetermined number of times (for example, twice), the display control unit 53 may smoothly scroll the display object upward or downward. If it is detected that the user has closed their eyelids for a predetermined period of time (for example, one second) during the smooth scrolling, the display control unit 53 may stop the scrolling.

[0054] 13, the display control unit 53 may determine whether the display object includes text information, and if it determines that the display object includes text information, may scroll the display object in accordance with the user's action of reading the text information line by line. For example, when the user's line of sight moves from one row to the next, the display control unit 53 may scroll the display object in accordance with the movement of the user's line of sight in the column direction perpendicular to the row direction.

[0055] 13, the display control unit 53 detects the number of blinks and the duration of the blinks of the user, and can determine that the user's eyes are fatigued if the number of blinks per unit time exceeds a predetermined threshold or the duration of each blink is longer than a predetermined threshold. If the display control unit 53 determines that the user's eyes are fatigued, it can adjust the brightness of the display unit 20, for example. For example, the display control unit 53 can adjust the brightness by dimming the brightness of the display unit 20 when the predetermined threshold is exceeded or the duration is longer than the predetermined threshold, and returning the brightness of the display unit 20 to its original brightness when the predetermined threshold is reached.

[0056] 13 , in the case where a sensor capable of detecting the user's walking or the like by detecting vibrations, acceleration, or the like of the housing 10 is separately provided, the display control unit 53 can determine whether or not the user's line of sight is on the display unit 20 when the user's walking is detected. If the display control unit 53 determines that the user's line of sight is on the display unit 20 when the user's walking is detected, it can display warning information against looking at the display unit 20 while walking or turn off the display on the display unit 20.

[0057] Fig. 14 is a flowchart showing the flow of the operation of the display device 100. As shown in Fig. 14, when a display object is displayed on the display unit 20, the face angle detection unit 51 detects the face angle between the display unit 20 and the face of the user (step S201). In addition, the gaze / eyelid opening / closing detection unit 52 detects at least one of the gaze and eyelid opening / closing action of the user (step S202).

[0058] The display control unit 53 determines whether the face angle exceeds a threshold value (step S203), and if it determines that the face angle does not exceed the threshold value (No in step S203), it maintains the display angle of the display object (step S204).

[0059] On the other hand, if it is determined that the threshold value is exceeded (Yes in step S203), the display control unit 53 determines whether the user is in a predetermined non-viewing state (step S205).If it is determined that the user is not in a non-viewing state (No in step S205), the display control unit 53 adjusts the display angle of the display object by rotating the display object around the reference position (step S206).

[0060] If it is determined that the user is in a non-viewing state (Yes in step S205), the display control unit 53 prevents the display object from rotating (step S207). Thereafter, it determines whether the non-viewing state of the user has been resolved (step S208). If it is determined that the non-viewing state has not been resolved (No in step S208), the operation of step S208 is repeated to maintain the state in which the display object is not rotated. Furthermore, if it is determined that the non-viewing state has been resolved (Yes in step S208), the display control unit 53 adjusts the display angle of the display object based on the face angle at the time of the determination. That is, the display control unit 53 determines whether the face angle exceeds a threshold value at the time of the determination (step S209). If it is determined that the face angle does not exceed the threshold value (No in step S209), the display angle of the display object is maintained (step S204). On the other hand, if it is determined that the threshold value is exceeded (Yes in step S209), the display control unit 53 adjusts the display angle of the display object by rotating the display object around the reference position (step S206).

[0061] As described above, the display device 200 according to this embodiment includes a display unit 20, a face angle detection unit 51 that detects the face angle, which is the angle between the display unit 20 and the user's face, a gaze / eyelid opening / closing detection unit 52 that detects at least one of the user's gaze and eyelid opening / closing movement, and a display control unit 53 that adjusts the display angle of the display object by rotating the display object around a reference position of the display unit 20 in accordance with the face angle detection result, determines whether the user is in a predetermined non-visual state based on at least one of the user's gaze and eyelid opening / closing movement, and prevents the display object from rotating if it is determined that the user is in a non-visual state.

[0062] The display method according to this embodiment includes detecting a face angle, which is the angle between the display unit 20 and the user's face, detecting at least one of the user's line of sight and eyelid opening / closing movement, adjusting the display angle of the display object by rotating the display object around a reference position of the display unit 20 according to the detection result of the face angle, determining whether the user is in a predetermined non-visual state based on at least one of the user's line of sight and eyelid opening / closing movement, and not rotating the display object if it is determined that the user is in a non-visual state.

[0063] According to this configuration, the display object does not rotate when it is determined that the user is in a non-visual state, which reduces the sense of discomfort felt by the user when rotating the display object on the display unit 20.

[0064] In the display device 200 according to this embodiment, when it is detected that the non-visible state has been resolved, the display control unit 53 adjusts the display angle of the display object based on the face angle at the time the non-visible state was resolved. With this configuration, when the non-visible state is resolved, the display angle of the display object is adjusted based on the face angle at that time, so that the display angle of the display object can be appropriately set at the timing when the user looks at the display unit 20.

[0065] In the display device 200 according to this embodiment, the gaze / eyelid opening / closing detection unit 52 detects the eyelid opening / closing action of the user, and the display control unit 53 at least sets and changes the initial value of the display angle of the display object according to the period during which the user keeps their eyelids closed. With this configuration, the initial value of the display angle of the display object can be set and changed with a simple operation.

[0066] In the display device 200 according to this embodiment, the gaze / eyelid opening / closing detection unit 52 detects both the gaze and the eyelid opening / closing action of the user, and the display control unit 53 changes the display mode of the display unit 20 based on at least one of the gaze and the eyelid opening / closing action of the user. With this configuration, the display mode of the display unit 20 can be appropriately changed with a simple operation.

[0067] The technical scope of the present invention is not limited to the above-described embodiment, and appropriate modifications can be made without departing from the spirit of the present invention. For example, in the above-described embodiment, the photographing unit 30 is provided in the housing 10, but the present invention is not limited to this. The photographing unit 30 may be provided separately from the housing 10, i.e., the display device 100, 200. [Explanation of symbols]

[0068] P...image information, T...text information, BP...reference position, EP...gaze, 10...casing, 20...display unit, 21...display object, 30...capturing unit, 40, 50...control unit, 41, 51...face angle detection unit, 42...gaze detection unit, 43, 53...display control unit, 44, 54...storage unit, 52...gaze / eyelid opening / closing detection unit, 100, 200...display device

Claims

1. A display unit; a face angle detection unit that detects a face angle between the display unit and a user's face; a gaze / eyelid opening / closing detection unit that detects at least one of the gaze and eyelid opening / closing action of the user; a display control unit that adjusts a display angle of the display object by rotating the display object around a reference position of the display unit according to a detection result of the face angle, determines whether the user is in a predetermined non-viewing state based on at least one of the line of sight and eyelid opening / closing action of the user, and prevents the display object from being rotated when it is determined that the user is in the non-viewing state; A display device comprising:

2. When it is detected that the non-viewing state has been resolved, the display control unit adjusts the display angle of the display target based on the face angle at the time when the non-viewing state has been resolved. The display device according to claim 1 .

3. the gaze eyelid opening / closing detection unit detects an eyelid opening / closing action of the user, The display control unit at least one of setting an initial value of the display angle of the display object and changing the setting depending on a period during which the eyelids of the user are closed. The display device according to claim 1 or 2.

4. the gaze / eyelid opening / closing detection unit detects both the gaze and eyelid opening / closing action of the user, The display control unit changes the display mode of the display unit based on at least one of the user's line of sight and the eyelid opening / closing action. The display device according to claim 1 .

5. Detecting a face angle, which is an angle between the display unit and the user's face; Detecting at least one of the user's line of sight and eyelid opening / closing action; adjusting a display angle of the display object by rotating the display object around a reference position of the display unit according to the detection result of the face angle; determining whether or not the user is in a predetermined non-viewing state based on at least one of the line of sight and eyelid opening / closing action of the user; and not rotating the display object when it is determined that the user is in the non-viewing state; Display methods including.

Images