Display device and display method

Abstract

To reduce discomfort given to a user, when a display object of a display part is rotated.SOLUTION: A display device includes: a display part; a face angle detection part for detecting a face angle which is an angle between the display part and a face of a user; a visual line eyelid opening / closing detection part for detecting at least one of a visual line and eyelid opening / closing operation of the user; and a display control part for adjusting a display angle of a display object by rotating the display object around a reference position of the display part according to the detection result of the face angle, determining whether or not the user is in a predetermined non-visible state on the basis of at least one of the visual line and the eyelid opening / closing operation of the user, and preventing the rotation of the display object, when determining that it is in the non-visible state.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a display device and a display method. [Background technology]

[0002] A display device that rotates a display object according to the angle between the display unit and the user's face is known. (See, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-167010 Summary of the Invention [Problem to be solved by the invention]

[0004] In the display device described in Patent Document 1, for example, when the user has his / her eyes closed, the user cannot see the display. The displayed object rotates when the user is not looking at the display, such as when the user is looking away from the display. In this case, it may cause discomfort to the user.

[0005] The present invention has been made in view of the above, and when rotating a display object on a display unit, The present invention aims to provide a display device and a display method that can reduce the sense of discomfort felt by the user. The target. [Means for solving the problem]

[0006] The display device according to the present invention has a display unit and a face angle, which is an angle between the display unit and the user's face. a face angle detection unit that detects the angle of the user's gaze and / or eyelid opening and closing; and a gaze point / eyelid opening / closing detection unit that detects the face angle and adjusts the display unit so that the reference position of the display unit is the center according to the detection result of the face angle. and rotate the display object to adjust the display angle of the display object, and and determining whether the user is in a predetermined non-visual state based on at least one of the eyelid opening and closing actions. If it is determined that the object is in the non-visual state, the display object is not rotated. and a display control unit.

[0007] The display method according to the present invention detects a face angle, which is the angle between the display unit and the user's face. and detecting at least one of the user's line of sight and eyelid opening / closing action. The display object is rotated around the reference position of the display unit according to the detection result of The display angle of the display object is adjusted based on at least one of the user's line of sight and eyelid opening and closing movement. and determining whether the user is in a predetermined non-visual state. When the rotation is detected, the display object is not rotated. [Effects of the Invention]

[0008] According to the present invention, when rotating a display object on a display unit, the sense of discomfort felt by the user is reduced. It is possible. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a display device according to a first embodiment. [Figure 2] FIG. 2 is a functional block diagram illustrating an example of the display device according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of a display method according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a display method according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of a display method according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a display method according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a display method according to the first embodiment. [Figure 8] FIG. 8 is a flowchart showing the flow of operations of the display device according to the first embodiment. [Figure 9] FIG. 9 is a functional block diagram illustrating an example of a display device according to the second embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a display method according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a display method according to the second embodiment. [Figure 12] FIG. 12 is a diagram showing an example of a display method according to the second embodiment. [Figure 13] FIG. 13 is a diagram showing an example of the relationship between detection targets of the user's line of sight and eyelid opening / closing action and the display control content when the detection targets are detected. [Figure 14] FIG. 14 is a flowchart showing the flow of operations of the display device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of a display device and a display method according to the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited to these embodiments. The components include those that are easily replaceable by a person skilled in the art or those that are substantially the same. do.

[0011] [First embodiment] FIG. 1 is a schematic diagram showing an example of a display device 100 according to a first embodiment. 1 is a functional block diagram illustrating an example of a display device 100 according to an embodiment. The display device 100 includes a housing 10, a display unit 20, an image capturing unit 30, and a control unit 40. The display device 100 may be a portable information terminal such as a smartphone or a tablet. stomach.

[0012] The housing 10 holds a display unit 20, a photographing unit 30, and a control unit 40. For example, an acceleration sensor (not shown) that can detect the user's walking may be provided.

[0013] The display unit 20 can display image information such as still images and moving images, and text information such as characters. The display unit 20 is, for example, a display such as a liquid crystal panel. For example, when the display unit 20 is in a rectangular shape, a predetermined reference direction is set. In the case of a shape, the reference direction can be one of two perpendicular sides.

[0014] The photographing unit 30 can photograph the face and eyes of the user. The photographing unit 30 photographs the face and eyes of the user. The photographing unit 30 generates photographed data. The photographing unit 30 transmits the generated photographed data to the control unit 40. A plurality of imaging units 30 may be provided.

[0015] The control unit 40 controls the overall operation of the display device 100. The control unit 40 includes a CPU (C Central Processing Unit and other processing units, and RAM (Random Access Memory) Access Memory (ROM) or ROM (Read Only Memory), etc. The control unit 40 includes a face angle detection unit 41, a line of sight detection unit 42, and a display control unit. The device has a processing unit 43 and a storage unit 44.

[0016] The face angle detection unit 41 detects the face angle of the face to be used with the display unit 20 based on the photographed data generated by the photographing unit 30. The face angle detection unit 41 detects the face angle between the user's face and the camera. The center line in the width direction is detected in the range from the jaw to the jaw, and the angle between the center line direction and the reference direction of the display unit 20 is calculated. The face angle is detected as a difference between the reference direction of the display unit 20 and the center line direction of the user's face. The face angle is a value indicating the angle relative to the center axis perpendicular to the display unit 20. The value indicates the difference in the rotational position of the display unit 20 in the reference direction and the user's The face angle changes when at least one of the center line directions of the face changes. The eye power detection unit 41 may determine the direction of the center line as a line connecting the centers of the user's left and right eyes.

[0017] The line of sight detection unit 42 detects the line of sight of the user based on the photographed data generated by the photographing unit 30. The line of sight detection unit 42 detects the position of the pupil of the user and the position of the corneal reflection, for example. The configuration may be such that the line of sight is detected, or the gaze is determined based on the position of the inner corner of the user's eye and the position of the iris. A configuration for detecting a line may also be used.

[0018] The display control unit 43 controls the display operation of the display unit 20. The display control unit 43 The display object is rotated around the reference position of the display unit 20 according to the detected angle. The display control unit 43 adjusts the display angle of the display object. For example, when the face angle is equal to or greater than a threshold value, The display control unit 43 can rotate the display object in response to the user's line of sight. When it is detected on the display unit 20, the position corresponding to the line of sight is set as the reference position.

[0019] The display control unit 43 determines whether the display object includes text information, and If it is determined that the user's line of sight is in the display area of ​​the text information, it is determined whether the user's line of sight is in the display area of ​​the text information. When the display control unit 43 determines that the user's line of sight is on the display portion of the text information, In this case, the center of the line of the text information where the line of sight is located is set as the reference position.

[0020] The display control unit 43 displays all the text information displayed on the display unit 20 immediately before the rotation. The display control unit 4 can adjust the size and rotate the display object so that the display object is displayed correctly. 3, if a part of the text information is enlarged and displayed on the display unit 20 immediately before the rotation, You can adjust the size and rotate the display so that the entire text information line is displayed. This can be done.

[0021] The storage unit 44 stores various information. The storage unit 44 may be, for example, a hard disk drive, The storage unit 44 has a storage such as a solid state drive. An external storage medium such as a bubble disk may also be used.

[0022] The storage unit 44 performs a process of detecting a face angle, which is the angle between the display unit 20 and the user's face, The process of detecting the line of sight of the user and adjusting the reference position of the display unit 20 according to the detection result of the face angle By rotating the display object as a When the line of sight is detected on the screen, the position corresponding to the line of sight is used as the reference position. The display program to be executed by the display device is stored.

[0023] Next, an example of a display method in the above-described display device 100 will be described. 3 is a diagram illustrating an example of a display method according to an embodiment. As shown in FIG. The display unit 20 displays the display object 21. The display object 21 includes, for example, image information P, text information T, etc. can be.

[0024] The photographing unit 30 photographs the face and eyes of the user who is looking at the display unit 20. The control unit 40 generates photographic data of the face and eyes of the subject and transmits the photographic data to the control unit 40. The face angle detection unit 41 detects the face angle of the user based on the photographed data. The detector 42 detects the line of sight of the user based on the photographed data.

[0025] For example, when a user goes from a sitting position to lying down while looking at the display unit 20 of the display device 100, When the face angle between the user and the display unit 20 changes, the face angle between the user and the display unit 20 may change. When the face angle of the user detected by the display control unit 43 exceeds the threshold value, the display control unit 43 As shown in FIG. 4, the display control unit 43 adjusts the display angle of, for example, the display object 21. The center of the image information P is set as the reference position, and the display object is rotated 90° around the reference position. When adjusting the display angle of the display object, The display control unit 43 is not limited to a configuration in which the rotation angle is 90°, but can be configured to rotate at 30°, 60°, 120°, or the like. The rotation angle may be different from 90°, for example, 90°.

[0026] When the display object 21 includes text information T, the display control unit 43 performs the following process. That is, the display control unit 43 determines whether the display object includes text information T, If it is determined that the text information T is included, the user's line of sight EP is directed to the display part of the text information. Then, the display control unit 43 determines whether the user's line of sight EP is in line with the text information. If it is determined that the line of sight EP is present in the display area of ​​the information, as shown in FIG. The display object 21 can be rotated with the center of the text information in the row direction as the reference position BP. When multiple lines of text information are displayed, the display control unit 43 sets the reference position BP to the line of sight EP It may be set to a position shifted to the next line relative to the line where it exists. In this case, the display object 2 Rotating the 1 reveals more of the text information the user is about to read. In addition, the display control unit 43 sets the reference position BP so as to coincide with the line of sight EP. The display control unit 43 may determine whether the display object 21 includes the text information T. Regardless of the position of the display object 21, when the display object 21 is rotated, the position where the user's line of sight is located on the display unit 20 is The position may be used as the reference position.

[0027] Furthermore, when rotating the display object 21, the display control unit 43 performs the following steps immediately before the rotation, as shown in FIG. The display object 21 is arranged so that all of the text information T displayed on the display unit 20 is displayed. In this case, the reference position BP set at the time of rotation is adjusted to the size of the display unit 20. It does not have to be centrally located.

[0028] Furthermore, as shown in FIG. 7, when rotating the display object 21, the display control unit 43 Next, it is determined whether or not a part of the text information T is being enlarged and displayed on the display unit 20. The display control unit 43 determines that a part of the text information T is being enlarged and displayed on the display unit 20. When this is done, the size of the display object 21 is adjusted so that the entire line of the text information T is displayed. You can adjust it.

[0029] FIG. 8 is a flowchart showing the flow of the operation of the display device 100 according to the first embodiment. As shown in FIG. 8, when a display object is displayed on the display unit 20, the face angle detection unit 4 1 detects the face angle between the display unit 20 and the user's face (step S101). The line of sight detection unit 42 detects the line of sight of the user (step S102).

[0030] The display control unit 43 determines whether the face angle exceeds a threshold value (step S103), and If it is determined that the display angle does not exceed the predetermined value (No in step S103), the display angle of the display object is maintained. (Step S104).

[0031] On the other hand, if it is determined that the threshold value is exceeded (Yes in step S103), the display control unit 43 It is determined whether the display object includes text information displayed in the row direction (step S10 5) If it is determined that the text information displayed in the row direction is included (Ye in step S105), s), the display control unit 43 determines whether the user's line of sight is on the display part of the text information. It is determined that the user's line of sight is on the display portion of the text information (step S106). If so (Yes in step S106), the display control unit 43 The center of the information in the row direction is set as the reference position (step S107). If it is determined that the text information displayed in the line direction is not included (No in step S105), Or, in step S106, if the user's line of sight is not on the display portion of the text information, If so (No in step S106), the display control unit 43 sets the predetermined position as the reference position. After setting the reference position, the display control unit 43 sets the reference position as the center. The display object is rotated as described above (step S108).

[0032] As described above, the display device 100 according to this embodiment includes the display unit 20 and the a face angle detection unit 41 for detecting a face angle between the user's face and the face of the person; The display unit 20 displays the image based on the reference position according to the detection result of the face angle. By rotating the object, the display angle of the displayed object is adjusted, and the user's line of sight is detected on the display unit 20. When the display is displayed, the display control unit 43 uses the position corresponding to the line of sight as the reference position.

[0033] In addition, the display method according to this embodiment uses a face angle, which is the angle between the display unit 20 and the user's face. The display unit detects the angle of the face, detects the line of sight of the user, and adjusts the display unit in accordance with the detection result of the face angle. The display angle of the display object can be adjusted by rotating the display object around 20 reference positions. When the user's line of sight is detected on the display unit 20, the position corresponding to the line of sight is set as the reference position. This includes the following.

[0034] According to this configuration, when the display object of the display unit 20 is rotated, the user's line of sight is When the line of sight is detected on the screen 20, the display object is rotated with the position corresponding to the line of sight as the reference position. This allows the part the user was looking at just before the rotation to be displayed in the appropriate position. .

[0035] In the display device 100 according to this embodiment, the display control unit 43 controls the display device 100 so that the display object is displayed in the row direction. If the text information is displayed in the line direction, If it is determined that the user's line of sight is in the display area of ​​the text information, If it is determined that the user's gaze is in the display area of ​​the text information, the text where the gaze is According to this configuration, the center of the text information in the line direction is set as the reference position. The part that the user was looking at just before the rotation can be displayed in an appropriate position.

[0036] In the display device 100 according to this embodiment, the display control unit 43 controls the display unit 20 immediately before the rotation. Adjust the size of the display so that all the text information displayed on the According to this configuration, the user who is looking at the text information can easily see the difference between before and after the rotation. It can reduce the sense of harmony.

[0037] In the display device 100 according to this embodiment, the display control unit 43 receives text information immediately before the rotation. When a part of the information is enlarged and displayed on the display unit 20, the entire text information in the row direction is The size of the object to be displayed is adjusted and rotated so that the object can be displayed. On the other hand, it allows the user to grasp the entire line direction of the text information, including the part they were looking at just before the rotation. Cut.

[0038] [Second embodiment] FIG. 9 is a functional block diagram showing an example of a display device 200 according to the second embodiment. As shown in FIG. 1, the display device 200 includes a housing 10, a display unit 20, an image capturing unit 30, and a control unit 5. The housing 10 has the display unit 20 and the photographing unit 30 configured as in the first embodiment. This is the same as the display device 100 according to the first embodiment.

[0039] In this embodiment, the configuration of the control unit 50 is the same as that of the control unit of the display device 100 in the first embodiment. The control unit 50 is different from the face angle detection unit 40. The following will mainly explain the differences. 1, a gaze point / eyelid opening / closing detection unit 52, a display control unit 53, and a storage unit 54. The face angle detection unit 51 is similar to the face angle detection unit 41 of the first embodiment.

[0040] The eyelid opening / closing detection unit 52 detects the eyelid opening / closing state of the user based on the photographed data generated by the photographing unit 30. The eyelid opening / closing detection unit 52 detects at least one of the gaze line and the eyelid opening / closing action of the user. The gaze may be detected based on the position of the pupil and the position of the corneal reflection. The gaze may be detected based on the position of the inner corner of the user's eye and the position of the iris. The gaze eyelid opening / closing detection unit 52 can detect the movement of the user's eyelids based on image processing. .

[0041] The display control unit 53 controls the display operation of the display unit 20. The display control unit 53 As in the embodiment, the display area is adjusted around the reference position of the display unit 20 according to the detection result of the face angle. The display angle of the display object is adjusted by rotating the elephant. and determining whether the user is in a predetermined non-visual state based on at least one of the eyelid opening and closing actions. If it is determined that the object is not visible, the display object is not rotated. In the form, the non-visible state is a state in which the user has his / her eyelids closed and the user's line of sight is not directed to the display unit 2. The display control unit 53 includes at least one of the states not existing on the eyelid opening / closing detection unit 52 and the state not existing on the eyelid opening / closing detection unit 53. When the detection unit 52 detects that the user has closed his / her eyelids, the user is in a non-visual state. In addition, the display control unit 53 can determine that, for example, the eyelid opening / closing detection unit 52 When the user's line of sight is detected in a direction away from the display unit 20, the user is in a non-visual state. When the non-visual state is detected to be resolved, the display control unit 53 determines that the non-visual state is resolved. In this case, the display angle of the display object is determined based on the face angle at the time when the non-visual state is resolved. Adjust.

[0042] The display control unit 53 adjusts the initial display angle of the display object according to the period during which the user's eyelids are closed. The initial value of the display angle can be set and / or changed. The display angle of the display object that is first displayed when the operation of the device 200 is started or resumed. be.

[0043] The display control unit 53 controls the display unit based on at least one of the user's line of sight and eyelid opening / closing action. The display mode of the display unit 20 can be changed. The eyelid opening and closing movement of the user may be, for example, Examples include the period during which the eyelids are closed and the number of blinks. In addition, by detecting acceleration, etc., When other components such as a sensor capable of detecting walking or the like are separately provided in the display device 200, The display control unit 53, together with other components such as the sensor, detects at least the gaze and eyelid opening and closing movements of the user. The display mode can be changed by combining either one of them.

[0044] The storage unit 54 stores various information. The storage unit 54 may be, for example, a hard disk drive, The storage unit 54 has a storage such as a solid state drive. An external storage medium such as a bubble disk may also be used.

[0045] The storage unit 54 performs a process of detecting a face angle, which is the angle between the display unit 20 and the user's face, A process for detecting at least one of the user's line of sight and eyelid opening and closing movement, and a process for detecting the face angle according to the result of the detection The display angle of the display object is adjusted by rotating the display object around the reference position of the display unit 20. and adjusts the predetermined non-visual state based on at least one of the user's line of sight and eyelid opening / closing action. If it is determined that the object is not visible, the display object is rotated. The display program for causing a computer to execute the process of preventing the display of the image from being displayed is stored.

[0046] Next, an example of a display method in the above-described display device 200 will be described. 10 is a diagram showing an example of a display method according to the second embodiment. The display object 21 is displayed on the display unit 20. The user can see the display object 21 displayed on the display unit 20. can.

[0047] The photographing unit 30 photographs the face and eyes of the user who is looking at the display unit 20. The control unit 50 generates photographic data of the face and eyes of the subject and transmits the photographic data to the control unit 50. The face angle detection unit 51 detects the face angle of the user based on the photographed data. The opening / closing detector 52 detects the user's line of sight or eyelid opening / closing action based on the photographed data. .

[0048] When the face angle of the user detected by the face angle detection unit 51 exceeds the threshold, the display control unit 5 3 adjusts the display angle of the display object. When the face angle changes, the display control unit 53 The display control unit 53 determines whether the user has their eyelids open. When the user's line of sight is detected on the display unit 20, In this case, the display control unit 53 determines that the user is not in the non-visual state. The display angle is adjusted by rotating the display object 21 displayed on the display unit 20.

[0049] On the other hand, when it is detected that the user has his / her eyelids closed, or when the user's eyes are If it is detected that the line does not exist on the display unit 20, it is determined that the user is in a non-visual state. In this case, the display control unit 53 controls the display unit 20 to display the image as shown in FIG. Prevent the target 21 from rotating. If it is detected that the user has opened their eyelids afterwards, When it is detected that the user's line of sight is on the display unit 20, the display control unit 53 In this case, the display control unit 53 determines that the non-visual state of the user has been resolved. In this way, the display unit 20 The display angle of the display object 21 displayed on the screen is adjusted.

[0050] FIG. 13 shows the detection targets of the user's gaze and eyelid opening / closing actions, and the results when the detection targets are detected. 13 is a diagram showing an example of the relationship between the display control contents. As shown in FIG. 13, the display control unit 53 The initial value of the display angle of the display object is set and changed depending on the period during which the user's eyelids are closed. When the user closes their eyelids for a first period (e.g., 1 second), at least one of the following can be performed: When the eyelid opening action is detected after the user opens the eyelid, the display control unit 53 The display angle of the display object can be set as the initial value of the display angle on the display unit 20. Also, after the user sets the initial value of the display angle, the eyelids are closed for a second period (for example, 2 seconds). When the eyelid opening action is detected after the eyelid is opened, the display control unit 53 resets the initial value of the display angle. can be eliminated.

[0051] As shown in FIG. 13, the display control unit 53 detects at least the line of sight and eyelid opening / closing movement of the user. The display mode of the display unit 20 can be changed based on either one of the above. When the line of sight is detected at the top of the display unit 20 and the blinking action is detected a first number of times (for example, twice), In this case, the display control unit 53 scrolls the display object upward by half a screen of the display unit 20. In addition, the user's line of sight is detected at the bottom of the display unit 20, and the blinking action is counted for the first number of times (e.g., For example, if the number of times is two, the display control unit 53 reduces the display object to half the screen of the display unit 20. You can scroll down.

[0052] Also, as shown in FIG. 13, when the user's line of sight is detected at the upper or lower part of the display unit 20, In this case, the blinking action is detected a second number of times (for example, three times) which is greater than the first number of times. In this case, the display control unit 53 scrolls the display object up or down by one screen of the display unit 20. In this way, the display control unit 53 can control the direction of the line of sight on the display unit 20. Set the direction of scrolling based on position and the number of blinks to determine scrolling direction. You can set the amount of cooling.

[0053] Also, as shown in FIG. 13, when the user's line of sight is detected at the upper or lower part of the display unit 20, In this case, if the blinking action is detected the predetermined number of times (for example, twice), the display control unit 5 3 may smoothly scroll the displayed object upward or downward. If it is detected that the user has closed their eyelids for a predetermined period (for example, 1 second) during the The control unit 53 may stop the scrolling.

[0054] As shown in FIG. 13, the display control unit 53 determines whether the display object includes text information. If it is determined that text information is included, the user can enter the text information line by line. For example, the display control unit 53 may scroll the display object in accordance with the reading action. When the user's line of sight moves from one row to the next, the use of the column direction perpendicular to the row direction The displayed object may be scrolled in accordance with the movement of the user's line of sight.

[0055] As shown in FIG. 13, the display control unit 53 also detects the number of blinks and the time duration of the blinks of the user. The length is detected, and when the number of blinks per unit time exceeds a predetermined threshold or when the number of blinks per blink is If the time length is longer than a predetermined threshold, it is determined that the user's eyes are fatigued. When it is determined that the user's eyes are tired, the display control unit 53 For example, the brightness of the display unit 20 can be adjusted. If the threshold is exceeded or if the time is longer than a predetermined threshold, the brightness of the display unit 20 is dimmed. When the brightness returns to within the predetermined threshold, the brightness of the display unit 20 is returned to the original brightness. The brightness can be adjusted.

[0056] As shown in FIG. 13, the walking speed of the user can be detected by detecting vibrations, acceleration, etc. of the housing 10. When a sensor capable of detecting the walking of the user is separately provided, the display control unit 53 When the display is turned on, it can be determined whether the user's line of sight is on the display unit 20. The control unit 53 detects that the user's line of sight is on the display unit 20 when the user's walking is detected. If it is determined that the user is not looking at the display unit 20 while walking, a warning message is displayed, or the display unit You can turn off the display of 20.

[0057] FIG. 14 is a flowchart showing the flow of the operation of the display device 100. As shown in the figure, when a display object is displayed on the display unit 20, the face angle detection unit 51 The facial angle between the display unit 20 and the user's face is detected (step S201). The closure detection unit 52 detects at least one of the user's line of sight and eyelid opening / closing action (step S 202).

[0058] The display control unit 53 determines whether the face angle exceeds a threshold value (step S203), and If it is determined that the display angle does not exceed the predetermined value (No in step S203), the display angle of the display object is maintained. (Step S204).

[0059] On the other hand, if it is determined that the threshold value is exceeded (Yes in step S203), the display control unit 53 Then, it is determined whether the user is in a predetermined non-visual state (step S205). If it is determined that the image is not in a visible state (No in step S205), the image is displayed with the reference position as the center. The display angle of the display object is adjusted by rotating the display object (step S206).

[0060] When it is determined that the user is in a non-visual state (Yes in step S205), the display control unit 53 prevents the display object from rotating (step S207). It is determined whether the visible state has been resolved (step S208). If it is determined that there is no such condition (No in step S208), the operation in step S208 is repeated. In addition, the display control unit 53 maintains the non-rotating state of the display object. If it is determined that the problem has been resolved (Yes in step S208), the face angle at the time of determination is In other words, the display control unit 53 adjusts the display angle of the display object based on the It is determined whether the face angle exceeds the threshold value (step S209), and if it is determined that the face angle does not exceed the threshold value, If so (No in step S209), the display angle of the display object is maintained (step S204). On the other hand, if it is determined that the threshold value is exceeded (Yes in step S209), the reference position is set as the center. The display angle of the display object is adjusted by rotating the display object (step S206).

[0061] As described above, the display device 200 according to this embodiment includes the display unit 20 and the a face angle detection unit 51 for detecting a face angle between the user's face and the face of the person; An eyelid opening / closing detection unit 52 detects at least one of the closing and closing movements, and a face angle detection unit 53 detects the closing and closing movements of the eyelids. The display angle of the display object is adjusted by rotating the display object around the reference position of the display unit 20. The user is in a predetermined non-visual state based on at least one of the user's line of sight and eyelid opening / closing action. If it is determined that the object is not visible, the display object is not rotated. The display control unit 53 controls the display.

[0062] The display method according to this embodiment detects the face angle, which is the angle between the display unit 20 and the user's face. detecting at least one of the user's line of sight and eyelid opening / closing action; and detecting the face angle. The display object is rotated around the reference position of the display unit 20 according to the detection result. The display angle of the object is adjusted based on at least one of the user's line of sight and eyelid opening and closing movements. It is determined whether the user is in a predetermined non-visual state, and if it is determined that the user is in a non-visual state, the display and preventing the object from rotating.

[0063] According to this configuration, when it is determined that the user is in a non-visual state, the display object does not rotate. This allows the user to rotate the display object on the display unit 20. The sense of discomfort can be reduced.

[0064] In the display device 200 according to this embodiment, the display control unit 53 If it is detected that the non-visual state has been resolved, the display is based on the face angle at the time when the non-visual state is resolved. With this configuration, when the non-visible state is resolved, the display angle of the displayed object is adjusted. Since the display angle of the display object is adjusted according to the face angle at the point, the time when the user looks at the display unit 20 is The display angle of the display object can be set appropriately by timing.

[0065] In the display device 200 according to this embodiment, the gaze eyelid opening / closing detection unit 52 detects whether the user is opening or closing the eyelid. The display control unit 53 detects the movement and adjusts the display of the display object according to the period during which the user's eyelids are closed. The initial value of the displayed angle is set and / or the setting is changed. The initial value of the display angle of the display object can be set or changed by operation.

[0066] In the display device 200 according to this embodiment, the gaze and eyelid opening / closing detection unit 52 detects the gaze and eyelid opening / closing state of the user. The display control unit 53 detects both the user's line of sight and the eyelid opening and closing action, and The display mode of the display unit 20 is changed based on either one of the two. The display mode of the display unit 20 can be changed appropriately.

[0067] The technical scope of the present invention is not limited to the above-described embodiment, and any modifications may be made without departing from the spirit of the present invention. For example, in the above embodiment, the photographing unit 30 is mounted on the housing The photographing unit 30 is provided in the housing 10 as an example, but is not limited to this. It may be provided separately from the body 10, that is, the display devices 100 and 200. [Explanation of symbols]

[0068] P...image information, T...text information, BP...reference position, EP...gaze, 10...casing, 20... Display unit, 21...display object, 30...photographing unit, 40, 50...control unit, 41, 51...face angle detection unit, 42... line of sight detection unit, 43, 53... display control unit, 44, 54... memory unit, 52... line of sight eyelid opening Closure detection unit, 100, 200...display device

Claims

1. A display unit; a face angle detection unit that detects a face angle between the display unit and a user's face; a gaze / eyelid opening / closing detection unit that detects at least one of the gaze and eyelid opening / closing action of the user; a display control unit that adjusts a display angle of the display object by rotating the display object around a reference position of the display unit in accordance with a detection result of the face angle, and changes a display mode of the display unit based on at least one of the line of sight of the user and the eyelid opening / closing action; A display device comprising:

2. Detecting a face angle, which is an angle between the display unit and a user's face; Detecting at least one of the user's line of sight and eyelid opening / closing action; adjusting a display angle of the display object by rotating the display object around a reference position of the display unit according to the detection result of the face angle, and changing a display mode of the display unit based on at least one of the line of sight of the user and the eyelid opening / closing action; A program that causes a computer to execute the following.

Images