Display control device, display control method, and program

Abstract

To provide a technology that reduces the burden on a user in terms of controlling the display status of a display unit in a device that includes a mirror and the display unit.SOLUTION: A display control device includes a mirror that reflects an optical reflected image on its front side and transmits light from behind, a display unit that is arranged behind the mirror, photographing means that photographs the field of view of the front side of the mirror, detection means that detects the user's status on the front side of the mirror, and control means for controlling the display state of images acquired by the photographing on the display unit on the basis of the user's status.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a display control device, a display control method, and a program. [Background technology]

[0002] Conventionally, mirror displays capable of displaying areas that are difficult to view using only an optical mirror have been known. Patent Document 1 discloses a technology that provides the function of a three-way mirror by displaying images captured by cameras arranged on the left and right sides of an optical mirror. Patent Document 2 discloses a technology that provides a function of displaying a full-body image by displaying images captured by a camera arranged above the optical mirror. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-166548 A [Patent Document 2] JP 2021-153918 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the technologies of Patent Document 1 and Patent Document 2, the user needs to specify the display mode by operating an operation unit such as a button. For example, when the user is brushing their teeth or putting on makeup, they may have some kind of tool in their hand, and when they want to check their outfit, they may be holding a bag or the like, so it is bothersome for the user to be required to operate a button or the like.

[0005] The present invention has been made in consideration of the above circumstances, and aims to provide a technique for reducing the burden on a user in controlling the display state of a display unit in a device equipped with a mirror and a display unit. [Means for solving the problem]

[0006] In order to solve the above problems, the present invention provides a display control device comprising: a mirror that projects an optical reflection image on its front surface and transmits light from behind; a display unit arranged behind the mirror; an imaging means that images the field of view on the front side of the mirror; a detection means that detects the state of a user on the front side of the mirror; and a control means that controls the display state of the image obtained by imaging on the display unit based on the state of the user. Effect of the Invention

[0007] According to the present invention, in a device including a mirror and a display unit, it is possible to reduce the burden on a user in controlling the display state of the display unit.

[0008] Other features and advantages of the present invention will become apparent from the accompanying drawings and the following detailed description of the preferred embodiments of the present invention. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing the appearance of a mirror display 100 which is an example of a display control device. [Diagram 2] FIG. 1 is a block diagram showing the configuration of a mirror display 100. [Diagram 3] 4 is a flowchart explaining the operation of the mirror display 100. [Figure 4] A diagram showing a user 401 standing in front of the mirror display 100. [Diagram 5] FIG. 4 is a diagram showing an example of a state in which a user 401 is gazing at the outside of a half mirror unit 103. [Figure 6] FIG. 13 is a diagram showing another example of a state in which the user 401 is gazing at the outside of the half mirror unit 103. [Figure 7] 4 shows a state in which a user 401 is gazing with his / her left eye at the optical image of himself / herself projected on the half mirror unit 103. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0011] [First embodiment] FIG. 1 is a diagram showing the appearance of a mirror display 100, which is an example of a display control device. The mirror display 100 is in the form of a washstand. The mirror display 100 includes a half mirror unit 103, and a display unit 102 is arranged behind the half mirror unit 103. The optical system 101 is composed of lenses and the like, and forms an optical image of a subject (such as a user) in front of the mirror display 100 on an imaging unit 105 described later. The gaze detection unit 104 detects the user's gaze. By standing in front of the mirror display 100, the user can check his or her own reflected image reflected in the half mirror unit 103, or display an image of himself or herself captured by the optical system 101 on the display unit 102 and check it. The display state of the display unit 102 is controlled based on the user's gaze detected by the gaze detection unit 104.

[0012] 2 is a block diagram showing the configuration of the mirror display 100. The control unit 108 is, for example, a CPU. The control unit 108 reads out a program for controlling the operation of each block of the mirror display 100 from the ROM 109, expands it into the RAM 110, and executes it to control the operation of each block of the mirror display 100. The ROM 109 is a rewritable non-volatile memory, and stores parameters and the like necessary for the operation of each block in addition to the program for controlling the operation of each block of the mirror display 100. The RAM 110 is a rewritable volatile memory, and is used as a temporary storage area for data output in the operation of each block of the mirror display 100.

[0013] The optical system 101 forms an optical image of a subject, such as a user, in front of the mirror display 100 on the imaging unit 105. The imaging unit 105 includes an imaging element, such as a CCD or CMOS sensor. The imaging unit 105 generates an analog image signal by photoelectrically converting the optical image formed on the imaging element by the optical system 101, and outputs the generated analog image signal to the A / D conversion unit 106. Therefore, the imaging unit 105 can capture the field of view on the front side of the half mirror unit 103.

[0014] The A / D conversion unit 106 applies A / D conversion processing to the input analog image signal to convert the analog image signal into digital image data. The A / D conversion unit 106 outputs the digital image data to RAM 110 for storage. The image data stored in RAM 110 is input to the image processing unit 107. In the image processing unit 107, the image data is subjected to processing such as color conversion, white balance, and gamma correction, and is converted into YCrCb signals (luminance signal and color difference signal).

[0015] The display unit 102 displays content such as image data generated by the image processing unit 107. The half mirror unit 103 is configured to project an optical reflection image on its front surface and transmit light from behind. Therefore, when the display unit 102 is off or displays black, the half mirror unit 103 projects an optical reflection image of a user standing in front of the display unit 102. On the other hand, when the display unit 102 displays content such as a captured image, the half mirror unit 103 displays the content displayed by the display unit 102 through the light.

[0016] The gaze detection unit 104 has a near-infrared camera and a near-infrared LED. The gaze detection unit 104 detects the center of the pupil and the Purkinje image illuminated by the near-infrared LED from the image of the user's eyeball captured by the near-infrared camera, and detects the user's gaze from their positional relationship. Furthermore, the gaze detection unit 104 detects where the user is gazing at on the mirror display 100 from the detected gaze. A known method may be used for gaze detection and gaze point detection.

[0017] Fig. 4 is a diagram showing a state in which a user 401 is standing in front of the mirror display 100. In Fig. 4, an optical reflection image of the user 401 is projected on the half mirror unit 103. A gaze point 402 is a gaze point of the user 401 detected by the line of sight detection unit 104. In Fig. 4, the user 401 is gazing at a position near the center of the half mirror unit 103.

[0018] 3 is a flowchart illustrating the operation of the mirror display 100. Unless otherwise specified, the processing of each step in this flowchart is realized by the control unit 108 executing a program stored in the ROM 109.

[0019] In S301, the control unit 108 determines whether or not the user 401 is gazing at the inside of the half mirror unit 103, which is an optical mirror, based on the gaze point of the user 401 (an example of a state related to the user's gaze) detected by the gaze detection unit 104. If the user 401 is gazing at the inside of the half mirror unit 103, the process proceeds to S303, and if not (if the user 401 is gazing at the outside of the half mirror unit 103), the process proceeds to S302.

[0020] In S302, the control unit 108 displays an image of a visual field corresponding to the gaze point of the user 401 on the display unit 102. Two examples of the process of S302 will be described with reference to Figs.

[0021] FIG. 5 is a diagram showing an example of a state in which the user 401 is gazing at the outside of the half mirror unit 103. The gaze point 501 is the gaze point of the user 401 detected by the line of sight detection unit 104. If the half mirror unit 103 is located up to the position of the gaze point 501, the feet of the user 401 are reflected as an optical reflection image on the half mirror unit 103. However, the actual half mirror unit 103 can only reflect the upper body of the user 401. When the user 401 is gazing at the gaze point 501, it is considered that the user 401 wants to check the whole body including the feet. Therefore, the control unit 108 causes the display unit 102 to display an image corresponding to the field of view including the whole body of the user 401 captured by the imaging unit 105.

[0022] FIG. 6 is a diagram showing another example of a state in which the user 401 is gazing at the outside of the half mirror unit 103. The gaze point 601 is the gaze point of the user 401 detected by the line of sight detection unit 104. If the half mirror unit 103 is located up to the position of the gaze point 601, the companion 602 standing next to the user 401 on the right side is reflected as an optical reflection image on the half mirror unit 103. However, the actual half mirror unit 103 can only reflect the upper body of the user 401. When the user 401 is gazing at the gaze point 601, it is considered that the user 401 wants to confirm that he or she is reflected next to the companion 602. Therefore, the control unit 108 causes the display unit 102 to display an image corresponding to a field of view including the user 401 and the companion 602 photographed by the imaging unit 105.

[0023] As in these examples, the control unit 108 can use the display unit 102 as an electronic mirror to display an image with a wider field of view on the display unit 102, including an area that is not reflected by the half mirror unit 103. By using the display unit 102 arranged behind the half mirror unit 103 as an electronic mirror in this way, the mirror function of the half mirror unit 103 can be expanded, and the convenience for the user 401 can be improved.

[0024] After the process of S302, in S306, the control unit 108 waits for a predetermined time (for example, 30 seconds). Since the process of waiting for a predetermined time is performed in this manner, even if the gaze point of the user 401 moves after the process of S302, the electronic mirror display started in S302 continues for the predetermined time (i.e., the state in which the captured image is displayed on the display unit 102 continues for the predetermined time). Therefore, for example, even if the user 401 gazes at the gaze point 501 and then gazes at the inside of the display unit 102 inside the half mirror unit 103, the whole body image of the user 401 continues to be displayed on the display unit 102 for the predetermined time. Therefore, the user 401 can carefully observe his or her own whole body image.

[0025] If it is determined in S301 that the user 401 is gazing at the inside of the half mirror unit 103, then in S303 the control unit 108 determines whether or not the user 401 is gazing at a specific part of the user 401 inside the half mirror unit 103. If the user is gazing at a specific part, the process proceeds to S304, and if not, the process proceeds to S305. The specific part is not particularly limited, and for example, the left and right eyes, the mouth, etc. can be used as the specific part.

[0026] In S304, the control unit 108 causes the gazed-at specific part to be enlarged and displayed on the display unit 102. An example of the process of S304 will be described with reference to FIG.

[0027] FIG. 7 is a diagram showing a state where the user 401 is gazing at the left eye of the user's own optical image projected on the half mirror unit 103. The control unit 108 enlarges and displays the left eye of the user 401 inside the area 701 of the display unit 102 so that the left eye of the user 401 is displayed large. The control unit 108 displays black in the area outside the area 701. Therefore, the optical reflection image continues to be projected in the area of ​​the half mirror unit 103 that does not overlap with the area 701. That is, the user 401 can visually recognize the optical reflection image reflected in the area of ​​the half mirror unit 103 that corresponds to the area (area other than the partial area) that does not overlap with the area 701 (partial area of ​​the display unit 102). When the user 401 wants to check a specific part in detail using the half mirror unit 103, which is an optical mirror, he or she needs to get close to the optical mirror, which is troublesome because the user 401 will end up in an awkward position or the breath will get on the optical mirror and cloud it. According to this embodiment, the mirror function of the half mirror unit 103 can be expanded by enlarging and displaying the gazed-at part on the electronic mirror, thereby improving the convenience of the user 401. The magnification ratio of the magnified display may be fixed. In this case, the processing load of the control unit 108 is reduced. Alternatively, it may be considered that the appropriate magnification ratio differs because the eyes and the mouth have different sizes, and that preferred magnification ratios also vary depending on age and individual differences. Therefore, the control unit 108 may change the magnification ratio depending on the type of gazed-at specific part, the age of the user 401, who the user 401 is, and the like.

[0028] After the process of S304, in the same manner as when the process of S302 is performed, the control unit 108 waits for a predetermined time (for example, 30 seconds) in S306.

[0029] If it is determined in S301 that the user 401 is not gazing at a specific part (for example, if the user 401 is vaguely checking the inside of the half mirror unit 103 or checking the whole area evenly), the process of S305 is performed. In S305, the control unit 108 turns off the display unit 102 (or displays black on the display unit 102) to put the half mirror unit 103 into an optical mirror state.

[0030] In S307, the control unit 108 determines whether or not to end the process. For example, when an operation to turn off the power of the mirror display 100 is performed, the control unit 108 determines to end the process. If it is determined that the process is to end, the process of this flowchart ends. If it is not determined that the process is to end, the process returns to S301.

[0031] 3, the control unit 108 controls the display state of the display unit 102 based on the user's gaze point detected by the gaze detection unit 104. Here, the user's gaze point is an example of the user's state, and generally speaking, the control unit 108 controls the display state of the display unit 102 based on the user's state.

[0032] The state of the user in this embodiment is not limited to the gaze point, and may be any of various states including the gaze point, or any combination thereof. Various examples of the user state will be described below.

[0033] For example, the control unit 108 may detect the orientation of the user's face by performing processing such as organ detection on the user's face captured by the imaging unit 105. In this case, for example, in S301, the control unit 108 may advance the process to S303 if the user's face faces forward, and may advance the process to S302 if the user's face does not face forward. In this way, the state of the user may include a state regarding the orientation of the user's face.

[0034] In the above description, in S303 in FIG. 3, the control unit 108 determines whether the user 401 is gazing at a specific part, but this embodiment is not limited to this configuration. For example, in S303, the control unit 108 may determine whether the user has pointed to a specific part of himself / herself with his / her finger based on an image of the user captured by the imaging unit 105. If the user has pointed to a specific part of himself / herself with his / her finger, the process proceeds to S304, and if not, the process proceeds to S305. In this way, the state of the user may include a state related to an instruction by the user's finger.

[0035] In the above description, in S301 of FIG. 3, the control unit 108 determines whether the user is gazing at the inside of the half mirror unit 103, but the present invention is not limited to such a configuration. For example, the control unit 108 may determine whether the user is gazing at the inside of a predetermined area. For example, when the mirror display 100 is in the form of a washstand as shown in FIG. 1, a place for placing a toothbrush and a water faucet are located immediately below the half mirror unit 103. When the user is gazing at a water faucet, etc., there is a possibility that the user wishes to maintain the optical mirror state. Therefore, an area slightly expanded downward from the area of ​​the half mirror unit 103 may be set as the predetermined area. In this case, when the user is gazing at the water faucet, the point of gaze is inside the predetermined area, so the optical mirror state is maintained. In addition, in the case of a mirror display that the user may use while sitting, such as a dressing table installed in a home or a cosmetics counter in a department store, the user cannot check his / her feet when sitting, so there is no need to display a full-body image on the display unit 102. Therefore, the control unit 108 may determine whether the user is sitting or not based on the image of the user captured by the imaging unit 105, and may change whether to expand the predetermined area downward depending on whether the user is sitting or standing. When the user is sitting, the control unit 108 may set an area that is a large expansion of the area of ​​the half mirror unit 103 in the downward direction as the predetermined area, thereby performing control so that switching to a display state of a substantial whole-body image does not occur when the user is sitting. In this way, the state of the user may include a state regarding whether the user is standing or sitting.

[0036] In the above description, in S303 of FIG. 3, the control unit 108 determines whether or not the user is gazing at a specific part of the optical reflection image of the user. In addition, the control unit 108 may determine whether or not the user is performing a specific activity registered in advance, such as brushing teeth or putting on makeup. For example, even if the user is gazing at a specific part, if the user is not performing the specific activity, the control unit 108 advances the process to S305 instead of S304. By adopting such a configuration, it is possible to avoid excessively enlarging and displaying a specific part against the user's intention. In this way, the user's state may include a state related to the user's activity.

[0037] In this embodiment, control is performed such that an image of a visual field according to a user's gaze point is displayed on the electronic mirror in S302 in Fig. 3, and a specific part is enlarged and displayed on the electronic mirror in S304. In order to realize this control, a configuration may be adopted in which the optical system 101 is panned and tilted or the focal length of the optical system 101 can be changed. Alternatively, a configuration may be adopted in which the state of the optical system 101 is not changed and the image is trimmed by image processing to realize electronic panning and tilting or electronic zooming.

[0038] Furthermore, in S302, S304, and S305, the control unit 108 may instantaneously transition the display state of the display unit 102, or may transition the display state with visual effects such as zooming in, zooming out, or sliding.

[0039] In addition, the mirror display 100 in FIG. 1 is configured to be generally used in buildings, such as a washstand, but the present embodiment is not limited to such a configuration. For example, the technology of the mirror display 100 described above may be applied to an in-vehicle device such as a room mirror or a sun visor mirror of a car. Many users use sun visor mirrors for makeup, but since the space inside a car is smaller than that inside a home, it has been difficult to use them for purposes such as checking clothes. According to the present embodiment, it is possible to display the upper body and the like in addition to the face in a small car interior using an electronic mirror without manual operation, thereby improving the convenience of the user.

[0040] As described above, according to this embodiment, the mirror display 100 includes the half mirror unit 103 and the display unit 102 arranged behind the half mirror unit 103. The control unit 108 of the mirror display 100 captures an image of the field of view in front of the half mirror unit 103 using the imaging unit 105. The control unit 108 detects the state of the user in front of the half mirror unit 103. The state of the user includes, for example, the user's gaze point (state related to the user's line of sight). In this case, the control unit 108 detects the user's gaze point using the line of sight detection unit 104. Then, the control unit 108 controls the display state of the image acquired by shooting on the display unit 102 based on the state of the user (for example, whether the user's gaze point is inside the half mirror unit 103 or not). Examples of control of the display state on the display unit 102 of an image acquired by shooting include control to make the image displayed on the display unit 102 (e.g., S302 or S304 in FIG. 3) and control to make the image not displayed on the display unit 102 (e.g., S305 in FIG. 3).

[0041] For example, the control unit 108 controls the display unit 102 to display an image acquired by shooting according to a determination that the user's attention is directed to the outside of a predetermined area based on the area of ​​the half mirror unit 103. The state of being directed to the outside of a predetermined area based on the area of ​​the half mirror unit 103 is, for example, a state where the user's gaze point is outside the half mirror unit 103. Also, for example, the control unit 108 controls the display unit 102 to not display an image acquired by shooting according to a determination that the user's attention is directed to the inside of a predetermined area based on the area of ​​the half mirror unit 103. The state of being directed to the inside of a predetermined area based on the area of ​​the half mirror unit 103 is, for example, a state where the user's gaze point is inside the half mirror unit 103.

[0042] Therefore, according to this embodiment, the display state of the display unit 102 is controlled based on the user's state, and the user does not need to perform button operations, etc., thereby reducing the burden on the user in controlling the display state of the display unit 102.

[0043] [Other embodiments] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0044] [summary] The above-described embodiment discloses at least the inventions shown in the following items, but is not limited to these inventions. [Item 1] A mirror that reflects an optically reflected image on the front and transmits light from behind. A display unit disposed behind the mirror; An imaging means for imaging a field of view on the front side of the mirror; A detection means for detecting a state of a user on the front side of the mirror; a control means for controlling a display state of the image acquired by the photographing on the display unit based on the state of the user; A display control device comprising: [Item 2] The control means controls the image to be displayed on the display unit according to a determination that the state of the user is a first state. 2. The display control device according to item 1, [Item 3] The first state is a state in which the user's attention is directed outside a predetermined area based on the area of ​​the mirror. 3. A display control device according to item 2. [Item 4] After controlling the image to be displayed on the display unit, the control means controls the image to be displayed on the display unit for a predetermined period of time regardless of whether the state of the user is maintained in the first state or not. 4. The display control device according to item 2 or 3. [Item 5] The control means According to a determination that the state of the user is a first state, control is performed so that a first image corresponding to a first field of view on the front side of the mirror acquired by the photographing is displayed on the display unit; According to a determination that the state of the user is a second state, a second image corresponding to a second field of view on the front side of the mirror acquired by the photographing is controlled to be displayed on the display unit. 5. The display control device according to any one of items 2 to 4, [Item 6] The control means controls the display unit to enlarge and display a third image corresponding to the specific part of the user, the third image being acquired by the photographing, in accordance with a determination that the state of the user is a third state in which the attention of the user is directed to the specific part of the user. 6. The display control device according to any one of items 1 to 5, [Item 7] The control means, in accordance with a determination that the state of the user is the third state, controls the third image to be enlarged and displayed in the partial region of the display unit so that the user can visually recognize the optical reflection image reflected in an area of ​​the mirror corresponding to an area other than the partial region of the display unit. 7. The display control device according to item 6, [Item 8] The control means changes a magnification ratio of the third image in accordance with at least one of the type of the specific part and the age of the user. 8. The display control device according to item 6 or 7, [Item 9] The third state is a state in which the user's attention is directed to the specific part of the user and the user is performing a specific activity. 9. The display control device according to any one of items 6 to 8, [Item 10] The control means controls the display unit so that the image is not displayed on the display unit according to a determination that the state of the user is a fourth state. 10. The display control device according to any one of items 1 to 9, [Item 11] The fourth state is a state in which the user's attention is directed to within a predetermined area based on the area of ​​the mirror. 11. A display control device according to item 10, characterized in that: [Item 12] The state of the user includes at least one of a state regarding the user's line of sight, a state regarding the direction of the user's face, a state regarding an instruction by the user's finger, a state regarding whether the user is standing or sitting, and a state regarding an activity of the user. 12. The display control device according to any one of items 1 to 11, [Item 13] A display control method executed by a display control device including a mirror that projects an optical reflection image on a front surface and transmits light from behind, and a display unit disposed behind the mirror, comprising: an imaging step of imaging a field of view on the front side of the mirror; a detection step of detecting a state of a user on the front side of the mirror; a control step of controlling a display state of the image acquired by the photographing on the display unit based on the state of the user; A display control method comprising: [Item 14] A program for causing a computer to function as each of the means of the display control device according to any one of items 1 to 12.

[0045] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0046] 100...mirror display, 101...optical system, 102...display section, 103...half mirror section, 104...gaze detection section, 105...imaging section, 106...A / D conversion section, 107...image processing section, 108...control section, 109...ROM, 110...RAM

Claims

1. A mirror that reflects an optically reflected image on the front and transmits light from behind. A display unit disposed behind the mirror; An imaging means for imaging a field of view on the front side of the mirror; A detection means for detecting a state of a user on the front side of the mirror; a control unit that controls a display state of the image acquired by the photographing on the display unit based on the state of the user; A display control device comprising:

2. The control means controls the image to be displayed on the display unit in accordance with a determination that the state of the user is a first state. The display control device according to claim 1 .

3. The first state is a state in which the user's attention is directed outside a predetermined area based on the area of ​​the mirror.

3. The display control device according to claim 2.

4. After controlling the image to be displayed on the display unit, the control means controls the image to be displayed on the display unit for a predetermined period of time regardless of whether the state of the user is maintained in the first state or not.

3. The display control device according to claim 2.

5. The control means According to a determination that the state of the user is a first state, control is performed so that a first image corresponding to a first field of view on the front side of the mirror acquired by the photographing is displayed on the display unit; According to a determination that the state of the user is a second state, a second image corresponding to a second field of view on the front side of the mirror acquired by the photographing is controlled to be displayed on the display unit.

3. The display control device according to claim 2.

6. The control means controls the display unit to enlarge and display a third image corresponding to the specific part of the user, the third image being acquired by the photographing, in accordance with a determination that the state of the user is a third state in which the attention of the user is directed to the specific part of the user. The display control device according to claim 1 .

7. The control means controls, in accordance with a determination that the state of the user is the third state, so that the third image is enlarged and displayed in the partial region of the display unit so that the user can visually recognize the optical reflection image reflected in an area of ​​the mirror corresponding to an area other than the partial region of the display unit.

7. The display control device according to claim 6.

8. The control means changes a magnification ratio of the third image in accordance with at least one of the type of the specific part and the age of the user.

7. The display control device according to claim 6.

9. The third state is a state in which the user's attention is directed to the specific part of the user and the user is performing a specific activity.

7. The display control device according to claim 6.

10. The control means controls the display unit so that the image is not displayed on the display unit in accordance with a determination that the state of the user is a fourth state. The display control device according to claim 1 .

11. The fourth state is a state in which the user's attention is directed to an area inside a predetermined area based on the area of ​​the mirror. The display control device according to claim 10 .

12. The state of the user includes at least one of a state regarding the user's line of sight, a state regarding the direction of the user's face, a state regarding an instruction by the user's finger, a state regarding whether the user is standing or sitting, and a state regarding an activity of the user. The display control device according to claim 1 .

13. A display control method executed by a display control device including a mirror that projects an optical reflection image on a front surface and transmits light from behind, and a display unit disposed behind the mirror, comprising: an imaging step of imaging a field of view on the front side of the mirror; a detection step of detecting a state of a user on the front side of the mirror; a control step of controlling a display state of the image acquired by the photographing on the display unit based on the state of the user; A display control method comprising:

14. A program for causing a computer to function as each of the means of the display control device according to any one of claims 1 to 12.

Images