System and method

Abstract

To provide a system and method that alleviate user's dazzling and upgrade an ease of looking at an image.SOLUTION: A system includes a projection unit 501 that projects a projection image on an object, an imaging unit 503 that images the object on which the projection image is projected, a display unit 504 that displays a shot image taken by the imaging unit 503, a projection luminance adjustment unit 502 that adjusts a luminance at which the projection unit 501 projects the projection image, and a display brightness adjustment unit 505 that adjusts the brightness of a display image displayed by the display unit 504, The display brightness adjustment unit 505 adjusts the brightness while the shot image obtained by imaging the object, on which the projection image is projected at an appropriate luminance adjusted by the projection luminance adjustment unit 502, is being displayed on the display unit 504.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a system and method for projecting and viewing images.

Background Art

[0002] Make simulators have been developed that project images onto a user's face to ostensibly grasp the image when wearing makeup or artistic makeup.

[0003] For example, Japanese Patent Application Laid-Open No. 2013-182062 (Patent Document 1) discloses a display device including display means for displaying information corresponding to the state of an object so as to be seen superimposed on the object. According to Patent Document 1, information suitable for the state of the object can be notified.

[0004] By the way, when the object onto which an image is projected is the user's face, such as in a make simulator, since the light from the projector hits the user's face, the user may feel dazzled. In particular, when the projection brightness is increased to improve the vividness of the projected image, the dazzle felt by the user is remarkable.

[0005] Regarding this point, Patent Document 1 discloses a configuration in which the projector is arranged at a position where the user does not look directly. However, since there are individual differences in the way of feeling dazzle, simply changing the position of the projector does not necessarily reduce the dazzle felt by the user.

[0006] Therefore, a further technology for improving the convenience of the user has been demanded.

Summary of the Invention

Problems to be Solved by the Invention

[0007] The present invention has been made in view of the problems in the above prior art, and an object thereof is to provide a system and method for reducing the dazzle of the user and improving the visibility of the image.

Means for Solving the Problem

[0008] That is, according to the present invention, projection means for projecting a projection image onto an object, imaging means for imaging the object onto which the projection image is projected, display means for displaying the captured image captured by the imaging means, first adjustment means for adjusting the luminance of the projection image projected by the projection means, second adjustment means for adjusting the brightness of the display image displayed by the display means are included, while the captured image obtained by imaging the object onto which the projection image is projected with appropriate luminance by the first adjustment means is being displayed on the display means, the second adjustment means adjusts the brightness. A system is provided.

Advantages of the Invention

[0009] According to the present invention, a system and method for reducing user glare and improving image visibility can be provided.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Best Mode for Carrying Out the Invention

[0011] Hereinafter, the present invention will be described with embodiments, but the present invention is not limited to the embodiments described later. In each of the figures referred to below, the same reference numerals are used for common elements, and the description thereof will be omitted as appropriate.

[0012] FIG. 1 is a diagram showing a schematic configuration of the hardware of the entire system 10 in the present embodiment. As shown in FIG. 1, the system 10 of the present embodiment includes a projector 20, a camera 30, a display 40, and a remote controller 50. The projector 20, the camera 30, and the display 40 constituting the system 10 are configured to be mutually connectable by wired communication or wireless communication. Examples of the method of connecting the devices include connection via a network such as a LAN and connection using short-range wireless communication such as NFC, but these are merely examples and do not particularly limit the embodiment.

[0013] The projector 20 is a projection device that projects a predetermined image and constitutes the projection means in the present embodiment. The projector 20 of the present embodiment can project an image as an object for projecting the face of the user. The image projected by the projector 20 can be, for example, an image representing various makeup such as lipstick, blush, and eyeshadow. Note that the image in the present embodiment may be a moving image or a still image.

[0014] The camera 30 is a photographing device that photographs an image and constitutes the photographing means in the present embodiment. The camera 30 of the present embodiment can photograph the face of the user on which the image is projected by the projector 20. Note that the camera 30 may be attached to the display 40 or may be configured integrally with the display 40.

[0015] The display 40 is a display device that displays images and constitutes the display means in this embodiment. The display 40 of this embodiment can display the images captured by the camera 30. Here, as shown in FIG. 1, by configuring the camera 30 and the display 40 to face the user directly, the user can view the image of their own face displayed on the display 40 in the same sense as looking at a mirror. Therefore, with the configuration shown in FIG. 1, the user can view their own face with makeup simulation.

[0016] Note that the display 40 of this embodiment may be a mirror display with its surface subjected to half-mirror treatment. As a result, when the screen of the display 40 is in the on state, an image is displayed, and when it is in the off state, it can function as a mirror.

[0017] The remote controller 50 is an operating device that operates the projector 20, the camera 30, and the display 40 included in the system 10 and constitutes the operating means in this embodiment. The remote controller 50 of this embodiment is configured with a plurality of buttons, and by the user pressing the buttons, the projector 20, the camera 30, and the display 40 can be operated via infrared communication. The remote controller 50 outputs an infrared signal corresponding to the type of button pressed.

[0018] Note that in the embodiments described below, when it is necessary to distinguish various images, the image projected by the projector 20 is referred to as the "projected image", the image captured by the camera 30 is referred to as the "captured image", and the image displayed by the display 40 is referred to as the "displayed image".

[0019] Next, the hardware configurations of the respective devices included in the system 10 will be described with reference to FIGS. 2 to 4. FIG. 2 is a diagram showing the hardware configuration included in the projector 20 of this embodiment.

[0020] As shown in FIG. 2, the projector 20 of the present embodiment includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a media I / F (Interface) 204, an operation device 206, a power switch 207, a network I / F 208, an external device connection I / F (Interface) 209, a fan drive circuit 210, a cooling fan 211, an LD (Laser Diode) drive circuit 212, an LD light source 213, a projection device 214, a projection lens 215, and a bus line 216.

[0021] The CPU 201 controls the operation of the entire projector 20. The ROM 202 stores programs used to drive the CPU 201. The RAM 203 is used as a work area for the CPU 201.

[0022] The media I / F 204 controls the reading or writing (storage) of data to and from a recording medium 205 such as a flash memory.

[0023] The operation device 206 is provided with various keys, buttons, and LEDs (Light Emitting Diodes), etc., and is used to perform various operations other than turning on / off the power of the projector 20 by the user. For example, the operation device 206 receives instruction operations such as an operation to adjust the size of the projected image, an operation to adjust the color tone, a focus adjustment operation, and a keystone adjustment operation, and outputs the received operation content to the CPU 201.

[0024] The power switch 207 is a switch for switching the on / off of the power of the projector 20.

[0025] The network I / F 208 is an interface for performing data communication using a communication network such as the Internet.

[0026] The external device connection I / F 209 is directly connected to a PC (Personal Computer) and acquires control signals and image data between the PC and itself.

[0027] The fan drive circuit 210 is connected to the CPU 201 and the cooling fan 211, and drives / halts the drive of the cooling fan 211 based on a control signal from the CPU 201. By rotating, the cooling fan 211 exhausts the air inside the projector 20 to cool the inside of the projector 20.

[0028] The LD drive circuit 212 controls the lighting and extinguishing of the LD light source 213 under the control of the CPU 201. When the LD light source 213 is lit under the control of the LD drive circuit 212, it irradiates projection light onto the projection device 214. Based on the image data provided via the external device connection I / F 209 etc., the projection device 214 modulates the projection light from the LD light source 213 by a spatial light modulation method and projects the obtained modulated light as a projection image onto the projection surface of the screen through the projection lens 215. As the projection device 214, for example, a liquid crystal panel or a DMD (Digital Micromirror Device) etc. is used. The LD drive circuit 212, the LD light source 213, the projection device 214, and the projection lens 215 function as a projection unit (projection means) that projects a projection image onto the projection surface based on image data as a whole.

[0029] The bus line 216 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 201.

[0030] Also, when power supply power is supplied, the CPU 201 starts according to a control program stored in advance in the ROM 202, gives a control signal to the LD drive circuit 212 to light the LD light source 213, and gives a control signal to the fan drive circuit 210 to rotate the cooling fan 211 at a predetermined rated rotation speed. Also, when the supply of power supply power from the power supply circuit to the projector 20 is started, the projection device 214 becomes in a state where it can display an image, and further, power is supplied from the power supply circuit to various other components.

[0031] Also, when the power switch 207 of the projector 20 is turned off, a power-off signal is sent from the power switch 207 to the CPU 201. When the CPU 201 detects the power-off signal, it gives a control signal to the LD drive circuit 212 to turn off the LD light source 213. After that, when a predetermined time has elapsed, the CPU 201 gives a control signal to the fan drive circuit 210 to stop the cooling fan 211, terminates its own control process by itself, and finally gives an instruction to the power circuit to stop the supply of power.

[0032] Next, the camera 30 will be described. FIG. 3 is a diagram showing the hardware configuration included in the camera 30 of the present embodiment. As shown in FIG. 3, the camera 30 of the present embodiment includes a CPU 301, a ROM 302, a RAM 303, a media I / F 304, an operation device 306, a power switch 307, a network I / F 308, an external device connection I / F 309, a photographing device 310, and a bus line 316. Note that the CPU 301, ROM 302, RAM 303, media I / F 304, operation device 306, power switch 307, network I / F 308, external device connection I / F 309, and bus line 316 have the same configuration as the CPU 201, ROM 202, RAM 203, media I / F 204, operation device 206, power switch 207, network I / F 208, external device connection I / F 209, and bus line 216 of the projector 20 shown in FIG. 2, so detailed description thereof will be omitted.

[0033] The photographing device 310 is a device that photographs an image by converting light incident on the optical system into an electrical signal. The photographing device 310 of the present embodiment can be, for example, a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device) sensor, etc., but the embodiment is not particularly limited.

[0034] Next, the display 40 will be described. FIG. 4 is a diagram showing the hardware configuration included in the display 40 of the present embodiment. As shown in FIG. 4, the display 40 of the present embodiment includes a CPU 401, a ROM 402, a RAM 403, an operation device 406, a power switch 407, a network I / F 408, an external device connection I / F 409, a display device 410, and a bus line 416. Note that the CPU 401, ROM 402, RAM 403, operation device 406, power switch 407, network I / F 408, external device connection I / F 409, and bus line 416 have the same configuration as the CPU 201, ROM 202, RAM 203, media I / F 204, operation device 206, power switch 207, network I / F 208, external device connection I / F 209, and bus line 216 of the projector 20 shown in FIG. 2, so detailed description thereof will be omitted.

[0035] The display device 410 is a device that displays various images to the user. Examples of the display device 410 include an LCD (Liquid Crystal Display), an organic EL (electro-luminescence) display, etc., but the embodiment is not particularly limited thereto. Further, the display device 410 of the present embodiment may be configured as a touch panel display having, for example, the function of the operation device 406.

[0036] The hardware configuration of each device included in the system 10 of the present embodiment has been described above. Next, the functional means executed by each hardware in the present embodiment will be described with reference to FIG. 5. FIG. 5 is a software block diagram included in the system 10 of the present embodiment.

[0037] As shown in FIG. 5, the system 10 of the present embodiment includes functional means of a projection unit 501, a projection luminance adjustment unit 502, a photographing unit 503, a display unit 504, a display brightness adjustment unit 505, an operation unit 506, and a storage unit 507. The details of each functional means will be described below.

[0038] The projection unit 501 is a means for controlling the operation of the projector 20 and projecting a projection image at a predetermined luminance. The projection unit 501 constitutes the projection means in the present embodiment. The projection unit 501 in the present embodiment can project an image representing, for example, makeup onto the user's face.

[0039] The projection luminance adjustment unit 502 is a means for controlling the operation of the projector 20 and adjusting the luminance at which the projection unit 501 projects an image. The projection luminance adjustment unit 502 constitutes the adjustment means in the present embodiment. The projection luminance adjustment unit 502 in the present embodiment can adjust the luminance, for example, by a user operation via the operation unit 506. Further, the projection luminance adjustment unit 502 can read and adjust the luminance information stored in the storage unit 507.

[0040] The photographing unit 503 is a means for controlling the operation of the camera 30 and photographing an image. The photographing unit 503 constitutes the photographing means in the present embodiment. The photographing unit 503 in the present embodiment can photograph the face of the user on which the image is projected. The image photographed by the photographing unit 503 may be displayed on, for example, the display 40 or stored in the storage unit 507.

[0041] The display unit 504 is a means for controlling the operation of the display 40 and displaying an image at a predetermined brightness. The display unit 504 constitutes the display means in the present embodiment. The display unit 504 in the present embodiment can display the image photographed by the photographing unit 503.

[0042] The display brightness adjustment unit 505 is a means for controlling the operation of the display 40 and adjusting the brightness of the image displayed by the display unit 504. The display brightness adjustment unit 505 constitutes the adjustment means in the present embodiment. The display brightness adjustment unit 505 in the present embodiment can adjust the brightness, for example, by a user operation via the operation unit 506. Further, the display brightness adjustment unit 505 can read and adjust the luminance information stored in the storage unit 507.

[0043] The operation unit 506 is a means for operating each device constituting the system 10, and constitutes the operation means in the present embodiment. The operation unit 506 in the present embodiment may be configured as a remote controller 50, or may be configured as buttons such as operation devices 206, 306, and 406 provided in the projector 20, the camera 30, or the display 40, or may be configured in a form combining these. The user can adjust, for example, the brightness or the lightness by an operation via the operation unit 506.

[0044] The storage unit 507 is a means for controlling the operation of the storage devices included in each device constituting the system 10 and storing various data. The storage unit 507 constitutes the storage means in the present embodiment. The storage unit 507 in the present embodiment can store, for example, a predetermined set value associating the brightness of the projected image with the lightness of the displayed image as an initial value. Further, the storage unit 507 can store, as user information, a set value associating the brightness of the projected image adjusted by the user with the lightness of the displayed image. Further, the storage unit 507 can store a captured image captured by the camera 30. The storage destination of various data by the storage unit 507 in the present embodiment can be, for example, ROMs 202 and 402, RAMs 203 and 403, recording media 205 and 305, and the like.

[0045] Note that the above-described software blocks correspond to functional means realized by causing the CPUs 201, 301, and 401 to execute the programs of the present embodiment to function each hardware. Further, all of the functional means shown in each embodiment may be realized software-wise, or a part or all of them may be mounted as hardware providing equivalent functions. Further, the above-described each functional means may be realized by cooperation of two or more of the devices among the projector 20, the camera 30, and the display 40.

[0046] Next, the processing executed by each of the above-described functional means will be described with reference to FIG. 6. FIG. 6 is a flowchart showing the processing in the system 10 of the present embodiment. The system 10 starts the processing from step S1000.

[0047] In step S1001, the projection unit 501 projects an adjustment image onto the projection target. Here, the projection target of the image can be the user's face. In step S1001, the projection brightness adjustment unit 502 performs adjustment to darken the brightness of the projected image and then enables the projection unit 501 to project the image. Alternatively, in step S1001, the projection unit 501 may project the image at the brightness selected by the user from among the candidates for the initial brightness value.

[0048] Next, in step S1002, the imaging unit 503 images the face of the user onto which the image in step S1001 is projected. The captured image may be output to, for example, the display 40 or stored in the storage unit 507. In the subsequent step S1003, the display unit 504 displays the captured image on the display 40. In step S1003, the display brightness adjustment unit 505 performs adjustment with the brightness of the displayed image as a standard and enables the display unit 504 to display the image. Alternatively, in step S1003, the display unit 504 may display the image at the brightness selected by the user from among the candidates for the initial brightness value.

[0049] Thereafter, in step S1004, the user performs an operation to adjust the brightness of the projected image via the operation unit 506. The projection brightness adjustment unit 502 adjusts the brightness in response to the operation of the operation unit 506 by the user. In step S1004, the user performs an operation to set the brightness to a level that does not cause glare.

[0050] Subsequently, in step S1005, the user performs an operation to adjust the brightness of the display image via the operation unit 506. The display brightness adjustment unit 505 adjusts the brightness in response to the operation of the operation unit 506 by the user. In step S1005, the user adjusts the brightness while viewing the display image of the display 40, and adjusts it to a brightness at which the display image is easy to view. Therefore, for example, when the luminance of the projection image is set to a predetermined value that is not dazzling, if the user feels that the brightness is insufficient (the display image is difficult to see) when viewing the display image of the display 40, an adjustment to increase the brightness of the display image is performed.

[0051] Next, in step S1006, the process branches depending on whether or not the user has finished checking the brightness of the display image. If the check has not been completed (NO), the process returns to step S1005 and the process of adjusting the brightness of the display image is repeated. If the check has been completed (YES), the process proceeds to step S1007.

[0052] In step S1007, the storage unit 507 stores the adjusted luminance and the set value of the brightness. In step S1007, the set value of the luminance can be stored, for example, in the ROM 202, RAM 203, recording medium 205, etc. of the projector 20. Also, the set value of the brightness can be stored, for example, in the ROM 402, RAM 403, etc. of the display 40. In this case, the adjusted luminance and the set value of the brightness may be stored in association with each other. Also, the adjusted set value may be associated, for example, with information for identifying the user. By storing the set values in association in this way, when adjusting the luminance and brightness next time, the burden required for the adjustment can be reduced by reading out the stored set values. Note that the adjusted set value of the brightness may be stored in an external recording medium or the like.

[0053] After storing the set value in step S1007, in step S1008, the system shifts to the makeup simulation mode. The makeup simulation mode in step S1008 can be performed with the brightness and lightness adjusted in steps S10054 and S1005. Therefore, the user can perform the makeup simulation while viewing an image displayed with appropriate visibility without feeling dazzled. In the makeup simulation in step S1008, the storage unit 507 can store the captured image by the camera 30, for example, in the recording medium 305. Thus, the user can view the state of the makeup simulation at any timing.

[0054] After that, in step S1009, the system 10 ends the process.

[0055] By the process shown in FIG. 6, it is possible to improve the visibility of the displayed image while reducing the dazzle felt by the user.

[0056] Incidentally, the form of the display 40 in the present embodiment may be in various modified forms. Therefore, for example, as shown in FIG. 7, it may be configured as a transmissive display. FIG. 7 is a diagram showing the configuration of the display 40 in another example of the present embodiment.

[0057] The display 40 shown in FIG. 7 is configured as a transmissive display, and a light-shielding layer is provided on the surface on the side opposite to the light-emitting direction (the back side). As shown in FIG. 7, the display 40 is provided with an opening in a part of the light-shielding layer, and a camera 30 for capturing an image through the opening can be provided. The camera 30 can be installed at a position corresponding to the position of the user's eyes, and can capture an image of the user's face through the opening.

[0058] When the user views the display image on the display 40, if the camera 30 is provided outside the display area of the display 40 as shown in FIG. 1, the user's line of sight will deviate from the camera 30, and the user cannot receive a natural impression like a mirror from the display image. On the other hand, as shown in FIG. 7, by providing the camera 30 within the display area of the display 40, the user's line of sight will face the camera 30, and the user can view the display image with a natural feeling as if reflected in a mirror.

[0059] Furthermore, the display 40 of the present embodiment may be configured as a mirror display with its surface subjected to half-mirror treatment. In this way, when the screen display of the display 40 is in the on state, the user can view the captured image by looking at the display image. Also, when the screen display of the display 40 is in the off state, the area for displaying the image of the display 40 functions as a mirror. Therefore, when the user does not feel dazzled even if the brightness projected by the projector 20 is increased, by turning off the screen display and the user using the display 40 as a mirror, the user can check the state of their own face corresponding to the captured image. In this manner, by using the display 40 as a mirror when the screen is off, it is possible to avoid the delay in the process of displaying the image when the screen is on, and reduce the discomfort of the user.

[0060] As described above, according to the embodiment of the present invention, it is possible to provide a system and method that reduce the user's dazzle and improve the visibility of the image.

[0061] Each function of the embodiment of the present invention described above can be realized by a device-executable program described in C, C++, C#, Java (registered trademark), etc. The program of the present embodiment can be stored and distributed on a device-readable recording medium such as a hard disk device, CD-ROM, MO, DVD, flexible disk, EEPROM (registered trademark), EPROM, etc., and can also be transmitted via a network in a form that can be used by other devices.

[0062] Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in this specification refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, an ASIC (Application Specific Integrated Circuit) designed to execute each function described above, a DSP (digital signal processor), an FPGA (field programmable gate array), and devices such as conventional circuit modules.

[0063] As described above, the present invention has been described with embodiments. However, the present invention is not limited to the above-described embodiments, and as long as the functions and effects of the present invention can be achieved within the scope of embodiments that those skilled in the art can conceive, it is included in the scope of the present invention.

Explanation of Reference Numerals

[0064] 10…System, 20…Projector, 30…Camera, 40…Display, 50…Remote Control, 201, 301, 401…CPU, 202, 302, 402…ROM, 203, 303, 403…RAM, 204, 304…Media I / F, 205, 305,…Recording Medium, 206, 306, 406…Operation Device, 207, 307, 407…Power Switch, 208, 308, 408…Network I / F, 209, 309, 409…External Device Connection I / F, 210…Fan Drive Circuit, 211…Cooling Fan, 212…LD Drive Circuit, 213…LD Light Source, 214…Projection Device, 215…Projection Lens, 216, 316, 416…Bus Line, 310…Shooting Device, 410…Display Device, 501…Projection Unit, 502…Projection Luminance Adjustment Unit, 503…Shooting Unit, 504…Display Unit, 505…Display Brightness Adjustment Unit, 506…Operation Unit, 507…Storage Unit

Prior Art Documents

Patent Documents

[0065]

Patent Document 1

Claims

1. Projection means for projecting a projection image onto an object, Imaging means for imaging the object onto which the projection image is projected, Display means for displaying the captured image captured by the imaging means, First adjustment means for adjusting the luminance of the projection image projected by the projection means, Second adjustment means for adjusting the brightness of the display image displayed by the display means and the second adjustment means adjusts the brightness while the captured image of the object onto which the projection image is projected with appropriate luminance by the first adjustment means is being displayed on the display means. System.

2. The system according to claim 1, wherein the display means is configured as a mirror display.

3. The system according to claim 1, further comprising storage means for storing initial values of the luminance and the brightness.

4. The system according to claim 3, wherein the projection means projects the projection image with the initial value of the luminance stored in the storage means.

5. The system according to claim 3, wherein the display means displays the display image with the initial value of the brightness stored in the storage means.

6. The system according to claim 1, further comprising storage means for storing the luminance adjusted by the first adjustment means and the brightness adjusted by the second adjustment means.

7. The display means is configured as a transmissive display, and the display means captures the object through the aperture of the transmissive display. The system according to claim 1.

8. The system according to claim 1, further comprising storage means for storing the captured image.

9. A projection step of projecting a projection image onto an object, An imaging step of imaging the object onto which the projection image is projected, A display step of displaying the captured image captured in the imaging step, A first adjustment step of adjusting the luminance of the projection image projected in the projection step, A second adjustment step of adjusting the brightness of the display image displayed in the display step and the display step displays the captured image of the object onto which the projection image is projected with appropriate luminance, and the second adjustment step adjusts the brightness while the image is being displayed in the display step. Method.

Images