Image projection system and image projection method

Abstract

The invention relates to an image projection system and an image projection method. The objective of the invention is to appropriately irradiate projection light to an object to be projected. The image projection system includes: an image projection device that projects an image by irradiating projection light to an object to be projected; a detector that detects a direction in which the object to be detected of the object to be projected faces; and an information processing device that determines whether the direction of the projection light is within a predetermined angle including the direction in which the object to be detected is oriented, and whether the display image projection device is at an appropriate position where the direction of the projection light is outside the predetermined angle, on the basis of information indicating the direction in which the object to be detected is oriented as detected by the detector.

Description

Technical Field

[0001] The invention relates to an image projection system and an image projection method. Background Art

[0002] Projection mapping technology, which uses a projector to project images onto buildings, is well known. The projection object of projection mapping can be a person. For example, if makeup is projected onto a person's face, you can try out a variety of colors of makeup even if you don't actually put on makeup. If it is projected onto clothes, you can try out a variety of patterns and colors even if you don't actually wear them. However, since people move, if the projection is not coordinated with the movement of the person, the projected image will deviate from the desired projection position. For this reason, there is also a dynamic projection mapping technology that can track the movement of the person and project images in coordination with the person's movement.

[0003] Regarding the above-mentioned projection mapping technology, for example, the International Patent Application Gazette No. 2010 / 044204 discloses a technical solution, which includes: a movable projection unit that can move the projection position; a position detection unit that detects the position of the search object; a view detection unit that detects the view angle; and a control unit. If the searcher issues an instruction to search for the search object, the position detection unit detects the position of the search object, and the view detection unit detects the view angle of the searcher. If the search object is located where the projection unit can project, it is directly projected onto the search object. If the search object is located where the projection unit cannot project, the guidance information used to guide the searcher to find the search object is projected into the searcher's view angle.

[0004] However, when projection mapping is performed from an image projection device to a projection target, if the projection target is a person (projection target), there is a problem that the projection light from the image projection device dazzles the projection target. Summary of the invention

[0005] In view of the above problems, the present invention provides an image projection system and an image projection method, the purpose of which is to properly irradiate projection light onto a projection object.

[0006] In order to solve the above-mentioned problems and achieve the purpose, the present invention provides an image projection system, which includes: an image projection device, which projects an image by irradiating projection light to a projection object; a detector, which detects the direction of the detected object of the projection object; and an information processing device, which determines whether the direction of the projection light is within a specified angle including the direction of the detected object based on information indicating the direction of the detected object detected by the detector, and displays whether the image projection device is in an appropriate position where the direction of the projection light is outside the specified angle.

[0007] The present invention has the effect of appropriately irradiating a projection object with projection light. Description of the Drawings

[0008] Figure 1 It is a schematic diagram of dynamic projection mapping.

[0009] Figure 2 It is a schematic diagram of a person's perspective.

[0010] Figure 3 It is a schematic diagram of a projector configuration that dazzles the person being projected.

[0011] Figure 4 It is a schematic diagram of the overall configuration of an example of an image projection system related to the embodiment.

[0012] Figure 5 It is a schematic diagram of an example configuration of a projector and a line-of-sight detector of an image projection system related to the embodiment.

[0013] Figure 6 It is a schematic diagram of the operation when the direction of the projection light of the projector in the image projection system related to the embodiment enters the viewing angle.

[0014] Figure 7 It is a schematic diagram for explaining the operation when the direction of the projection light of the projector coincides with the line of sight in the image projection system of the embodiment.

[0015] Figure 8 It is a schematic diagram of the operation of the projector when the person being projected is looking at a mirror and not looking at a mirror in the image projection system related to the embodiment.

[0016] Fig. 9 It is a block diagram of an example of the hardware structure of a PC related to the embodiment.

[0017] Fig.10 It is a block diagram of an example of the hardware structure of a projector related to the embodiment.

[0018] Fig.11 It is a block diagram of an example of the hardware structure of a line-of-sight detector related to the embodiment.

[0019] Fig.12 It is a block diagram of an example of the functional module structure of an image projection system related to the embodiment.

[0020] Fig.13 It is a flowchart of an example when setting up a projector in an image projection system related to the embodiment.

[0021] Fig.14 It is a flowchart of an example of controlling the brightness of the projection light of an image projection system related to the embodiment.

[0022] Fig.15 It is a timing diagram of an example of the operation flow for controlling the brightness of the projection light of an image projection system related to the embodiment.

[0023] Explanation of symbols

[0024] 1 Image projection system

[0025] 10 The Projected

[0026] 20 Mirror

[0027] 100PC

[0028] 101 Ministry of Communications

[0029] 102 Line of sight information acquisition unit

[0030] 103 Angle determination department

[0031] 104 Judgment Department

[0032] 105 Projection Control Unit

[0033] 106 Operation input unit

[0034] 200, 200a projector

[0035] 300 sight detector

[0036] 701, 801CPU

[0037] 702, 802 ROM

[0038] 703, 803 RAM

[0039] 705 auxiliary storage device

[0040] 706, 806 recording medium

[0041] 707, 807 media drives

[0042] 708 Display

[0043] 709, 811 Network I / F

[0044] 710, 810, 910 bus

[0045] 711 Keyboard

[0046] 712 Mouse

[0047] 713DVD

[0048] 714DVD drive

[0049] 715, 818, 903 peripheral connection I / F

[0050] 808 Operation Department

[0051] 809 Power switch

[0052] 814 LD drive circuit

[0053] 815LD light source

[0054] 816 Projection Component

[0055] 817 Projection Lens

[0056] 819 Fan drive circuit

[0057] 820 Cooling Fan

[0058] 901 Control Department

[0059] 902 Testing Department DETAILED DESCRIPTION

[0060] The following is a detailed description of the embodiments of the image projection system and the image projection method of the present invention with reference to the accompanying drawings. The present invention is not limited to the following embodiments, and the constituent elements in the following embodiments include elements that are easily thought of by a person skilled in the art, are substantially the same, and are within the so-called equivalent range. Various omissions, substitutions, changes, and combinations of constituent elements can be made without departing from the scope of the following embodiments.

[0061] <About Dynamic Projection Mapping>

[0062] Figure 1 It is a schematic diagram of dynamic projection mapping. Figure 2 It is a schematic diagram of the human perspective. Figure 3 This is a diagram of the configuration of a projector that makes the person being projected feel dazzled. Figures 1 to 3 Let's briefly describe dynamic projection mapping.

[0063] Dynamic projection mapping refers to, for example, when the object being projected is a person, the mapping can track the person's movements and project images in accordance with the person's movements. In this case, the components required for projection mapping on a person, that is, dynamic projection mapping, are as follows: Figure 1 As shown, there are a projector 200, a mirror 20, and a projection target 10 (a person receiving projection). Figure 1 As shown, the projector 200 projects projection light onto at least one of the face and body of the projection target 10, and the projection target 10 confirms the state of being projected by the projection light through the mirror 20 provided in front of the eyes. Figure 1 The examples shown are examples of projecting makeup projection light onto the face of the projection target 10, or projecting clothes projection light onto the body, but the mirror 20 may not be required, for example, when used for stage performances.

[0064] Since the projector 200 projects an image to the projectee 10, the projectee 10 and the projector 200 are opposite to each other in most cases. In this positional relationship, when the projector 200 irradiates (projects) the projection light to the face of the projectee 10 or a body part close to the face, if the direction (irradiation direction, projection direction) of the projection light of the projector 200 enters the visual angle of the projectee 10, the projectee 10 will feel dazzled. The visual angle of a person has a certain range, such as Figure 2 As shown, the viewing angle is approximately 100 degrees in the left and right directions, approximately 60 degrees in the upper direction, and approximately 75 degrees in the lower direction. Figure 3 The example of the arrangement of the projector 200a when the direction of the projection light is within the angle of view is shown. When the projector 200a is arranged in this way, the person 10 will feel dazzled even if the projector 200a is not in front of the person 10 being projected. Here, the angle of view is an example of a "predetermined angle".

[0065] The following describes the configuration and control of the projector 200 in this embodiment, which can reduce the glare felt by the person 10 being projected.

[0066] <Overall Structure and Operation of Image Projection System>

[0067] Figure 4 FIG. 1 is a schematic diagram showing an overall configuration of an example of an image projection system according to an embodiment. Figure 5 The diagram is a schematic diagram showing an example of the configuration of a projector and a sight line detector of an image projection system according to an embodiment of the present invention. Figure 6 This is a schematic diagram of the operation when the direction of projection light of the projector enters the viewing angle in the image projection system of the embodiment. Figure 7 This is a schematic diagram of the operation when the direction of projection light from a projector matches the line of sight in the image projection system according to the embodiment. Figure 8 Schematic diagram of the operation of the projector when the person being projected looks at the mirror and when the person not looking at the mirror in the image projection system of the embodiment. Figures 4 to 8 The overall configuration and operation of the image projection system 1 according to this embodiment will be described.

[0068] Figure 4 The image projection system 1 shown can be used to implement dynamic projection mapping, detect the direction of a detected object, that is, the line of sight of a person, and project an image in accordance with the person's movements. Figure 4 As shown, the image projection system 1 includes a PC (Personal Computer) 100 , a projector 200 , and a sight line detector 300 .

[0069] The PC 100 is an information processing device that issues operation instructions to the projector 200 and the visual line detector 300. The PC 100 is not limited to a personal computer, and may be an information processing device such as a workstation or a server.

[0070] The projector 200 is an image projection device, and irradiates projection light for realizing an image of dynamic projection mapping in accordance with a command from the PC 100 .

[0071] The sight line detector 300 is an example of a detector, and detects the sight line of the projection subject 10 according to the instruction from the PC 100. The sight line detector 300 outputs information indicating the direction in which the detected object is facing, that is, sight line information of the detected sight line of the projection subject 10 to the PC 100. The sight line detector 300 may also adopt a method of photographing the face with a camera and inferring the sight line from the photographed image.

[0072] With such a configuration of the image projection system 1 , the person being projected 10 can use the mirror 20 to confirm an image projected onto his or her face or a body part close to the face by the projection light irradiated toward the face or a body part close to the face by the projector 200 .

[0073] like Figure 5 As shown, in this embodiment, the projector 200 is arranged so that the direction of the projection light irradiated by the projector 200 is located outside the viewing angle of the projectee 10. The projector can be arranged on any side of the viewing angle of the projectee 10 in the up and down direction ( Figure 5 The example is the upper side), and since the human face has unevenness, it is preferable to set the projector at a position where the shadow of the nose and the like is not easily produced. In this way, even if the projector 200 is set so that the direction of the projection light irradiated by the projector 200 is outside the viewing angle of the projected person 10, the projection mapping of the projected person 10 can be smoothly performed, and since the direction of the projection light is outside the viewing angle, the projected person 10 will not feel dazzled. The details of the setting method of the projector 200 will be referred to later. Fig.13 Describe in detail.

[0074] However, even if the projector 200 is set in the above manner, if the person being projected 10 moves his face, the direction of the projection light of the projector 200 enters the viewing angle and is dazzling. In view of this, in the image projection system 1 of the present embodiment, the line of sight of the person being projected 10 is detected, and the brightness of the projection light of the projector 200 is controlled according to the movement of the line of sight. Specifically, the image projection system 1 Figure 5 As shown, the projection system includes a line of sight detector 300 capable of detecting the line of sight of the projection subject 10. Figure 6 As shown, when the direction of the projection light enters the viewing angle of the projected person 10, or as Figure 7As shown, when the line of sight of the person 10 to be projected faces the direction of the projection light, the projector 200 controls the projection light to become dimmer. Regarding the method of dimming the projection light, for example, there are methods such as reducing the light amount of the projection light, turning off a part of the light sources of the projector 200, or projecting a black image. In this way, even if the direction of the projection light of the projector 200 enters the viewing angle of the person 10 to be projected, or the line of sight of the person 10 to be projected faces this direction, the glare felt by the person 10 to be projected can be reduced. The specific control actions regarding the projection light brightness of the projector 200 will be described later with reference to Fig.12 , Fig.14 and Fig.15 .

[0075] When the person 10 to be projected performs mapping while confirming the mirror 20, when the line of sight of the person 10 to be projected changes from the state facing the mirror 20 as shown in Figure 8 (a) to the state not facing the mirror 20 as shown in Figure 8 (b), the projector 200 stops projecting light. In this way, the projector 200 can be stopped from irradiating the projection light when it is not needed, so that unnecessary power consumption can be reduced. The detailed content of the projection light stop action of the projector 200 will be described later with reference to Fig.12 .

[0076] <Hardware Configuration of PC>

[0077] Fig. 9 is a schematic diagram of an example of the hardware structure of the PC related to the embodiment. The following will describe the hardware structure of the PC 100 of this embodiment with reference to Fig. 9 .

[0078] As Fig. 9 shown, the PC 100 includes a CPU (Central Processing Unit, central processing unit) 701, a ROM (Read Only Memory, read-only memory) 702, a RAM (Random Access Memory, random access memory) 703, an auxiliary storage device 705, a medium drive 707, a display 708, a network I / F (interface) 709, a keyboard 711, a mouse 712, a DVD (Digital Versatile Disc, digital versatile disc) drive 714, and a peripheral connection I / F (interface) 715.

[0079] The CPU 701 is an arithmetic device that controls the overall operation of the PC 100. The ROM 702 is a non-volatile storage device that stores programs for the PC 100. The RAM 703 is a volatile storage device used as the working area of the CPU 701.

[0080] The auxiliary storage device 705 is a storage device such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various data and programs, etc. The medium drive 707 is a device that controls the reading and writing of data in a recording medium 706 such as a flash memory according to the control of the CPU 701 .

[0081] The display 708 is a display device such as a liquid crystal or an organic EL (Electro Luminescence) that displays various information such as a cursor, a menu, a window, text, or an image.

[0082] The network I / F 709 is an interface for data communication with external devices through a network such as the Internet. The network I / F 709 is, for example, a NIC (Network Interface Card) that supports Ethernet (registered trademark) and can communicate based on TCP (Transmission Control Protocol) / IP (Internet Protocol) or the like. In addition, the network I / F 709 may also be an interface for wireless communication based on Wi-Fi (registered trademark) or the like.

[0083] The keyboard 711 is an input device for selecting text, numbers, and various instructions, moving a cursor, etc. The mouse 712 is an input device for selecting and executing various instructions, selecting a processing object, moving a cursor, etc.

[0084] The DVD drive 714 is a device that controls reading and writing of a DVD 713 such as a DVD-R (Digital Versatile Disk Recordable) which is an example of a removable storage medium.

[0085] The peripheral connection I / F 715 is an interface of a USB (Universal Serial Bus) standard or the like for communicating with peripheral devices. The peripheral connection I / F 715 performs data communication with, for example, the projector 200 and the line of sight detector 300 .

[0086] The CPU 701 , ROM 702 , RAM 703 , auxiliary storage device 705 , media drive 707 , display 708 , network I / F 709 , keyboard 711 , mouse 712 , DVD drive 714 and peripheral connection I / F 715 are connected to communicate with each other via a bus 710 such as an address bus and a data bus.

[0087] Fig. 9 The hardware structure of the PC 100 shown in FIG. 1 is not necessarily included in the present invention. Fig. 9Although all the components shown are included, other components may also be included.

[0088] exist Fig. 9 In the example shown, PC 100 is configured to communicate data with projector 200 and sight line detector 300 via peripheral connection I / F 715, but the present invention is not limited thereto. For example, PC 100 may communicate data with projector 200 and / or sight line detector 300 via network I / F 709.

[0089] <Projector Hardware Configuration>

[0090] Fig.10 FIG. 1 is a block diagram of an example of a hardware structure of a projector according to an embodiment of the present invention. Fig.10 , describing the hardware configuration of the projector 200 according to this embodiment.

[0091] like Fig.10 As shown, the projector 200 includes a CPU 801, a ROM 802, a RAM 803, a medium I / F 807, an operating unit 808, a power switch 809, a network I / F 811, an LD (laser diode) driving circuit 814, an LD light source 815, a projection device 816, a projection lens 817, an external device connection I / F 818, a fan driving circuit 819 and a cooling fan 820.

[0092] The CPU 801 is a computing device that controls the overall operation of the projector 200. The ROM 802 is a nonvolatile storage device that stores a program for driving the CPU 801. The RAM 803 is a volatile storage device used as a work area of ​​the CPU 801.

[0093] The medium I / F 807 is an interface circuit that controls the reading and writing of data from and to a medium 806 such as a flash memory.

[0094] The operation unit 808 is provided with various keys, buttons, and LEDs (Light Emitting Diodes) for performing various operations other than the user turning on / off the power of the projector 200. For example, the operation unit 808 receives instructions for adjusting the size of the projected image, adjusting the color tone, adjusting the focus, adjusting the trapezoid, and the like, and outputs the received operation content to the CPU 801.

[0095] The power switch 809 is a switch for switching the power of the projector 200 on and off.

[0096] The network I / F 811 is an interface circuit for performing data communication using a communication network such as the Internet.

[0097] The LD driving circuit 814 is a driving circuit that controls the lighting and extinguishing of the LD light source 815 under the control of the CPU 801. When the LD light source 815 is lit under the control of the LD driving circuit 814, it irradiates the projection device 816 with projection light.

[0098] The projection device 816 modulates the projection light from the LD light source 815 by spatial light modulation according to the image data obtained through the peripheral connection I / F 818, etc., and projects the modulated light (projection light) as an image onto the projection surface of the screen through the projection lens 817. For example, a liquid crystal panel or a DMD (Digital Micromirror Device) is used as the projection device 816.

[0099] The LD driving circuit 814 , the LD light source 815 , the projection device 816 , and the projection lens 817 as a whole function as a projection unit that projects an image of projection light onto a projection surface based on image data.

[0100] The peripheral connection I / F 818 is an interface of a USB standard or the like for performing data communication with a peripheral device. The peripheral connection I / F 818 receives a control signal and image data from the PC 100 , for example.

[0101] The fan driving circuit 819 is connected to the CPU 801 and the cooling fan 820, and is a driving circuit for driving / stopping the cooling fan 820 according to a control signal from the CPU 801. The cooling fan 820 is a fan device that is rotated by the fan driving circuit 819 to discharge the air inside the projector 200, thereby cooling the inside of the projector 200.

[0102] CPU801, ROM802, RAM803, media I / F807, operation unit 808, power switch 809, network I / F811, LD driving circuit 814, projection device 816, peripheral connection I / F818 and fan driving circuit 819 are electrically connected via a bus 810 such as an address bus and a data bus, so that data communication can be performed with each other.

[0103] After receiving power supply, CPU801 starts according to the control program pre-stored in ROM802, provides a control signal to LD drive circuit 814 to light up LD light source 815, and provides a control signal to fan drive circuit 819 to rotate cooling fan 820 at a specified rated speed. After the power supply of projector 200 starts, projection device 816 becomes a state in which image display can be performed. After the power switch 809 of projector 200 is OFF, power switch 809 sends a power OFF signal to CPU801. After detecting the power OFF signal, CPU801 provides a control signal to LD drive circuit 814 to turn off LD light source 815. Then, after a specified time, CPU801 provides a control signal to fan drive circuit 819 to stop cooling fan 820 and terminates its own control processing.

[0104] Fig.10 The hardware configuration of the projector 200 shown is an example, and the present invention does not necessarily include Fig.10 Although all the components shown are included, other components may also be included.

[0105] Fig.10 In the example of FIG. 8 , the projector 200 performs data communication with the PC 100 via the peripheral connection I / F 818 , but the present invention is not limited thereto. For example, the projector 200 may perform data communication with the PC 100 via the network I / F 811 .

[0106] <Hardware Configuration of the Eye-Sight Detector>

[0107] Fig.11 This is a hardware block diagram of a sight line detector according to an embodiment of the present invention. Fig.11 , describing the hardware structure of the sight line detector 300 of this embodiment.

[0108] like Fig.11 As shown, the sight line detector 300 includes a control unit 901, a detection unit 902 and an external device connection I / F 903.

[0109] The control unit 901 is a controller that controls the overall operation of the line of sight detector 300 .

[0110] The detection unit 902 is a device that detects the line of sight of the projection subject 10. The detection unit 902 transmits line of sight information indicating the detected line of sight to the PC 100 via the peripheral connection I / F 903.

[0111] The peripheral connection I / F 903 is an interface of a USB (Universal Serial Bus) standard or the like for communicating with peripheral devices. The peripheral connection I / F 903 performs data communication with the PC 100 , for example.

[0112] The control unit 901, the detection unit 902, and the peripheral connection I / F 903 are connected to each other via a bus 910 such as an address bus and a data bus so as to be able to communicate with each other.

[0113] Fig.11 An example of the hardware structure of the sight line detector 300 is shown, but the present invention does not need to include Fig.11 Although all the components shown are included, other components may also be included.

[0114] Fig.11 In the example shown in FIG. 1 , the sight line detector 300 communicates data with the PC 100 via the peripheral connection I / F 903, but the present invention is not limited to this. For example, data communication with the PC 100 may be performed via a network I / F not shown in the figure.

[0115] <Functional Block Configuration and Operation of Image Projection System>

[0116] Fig.12 FIG. 1 is a functional block diagram of an example of an image projection system according to an embodiment of the present invention. Fig.12 , the functional module structure and operation of the image projection system 1 of this embodiment are described.

[0117] like Fig.12 As shown, the PC 100 of the image projection system 1 includes a communication unit 101 , a line of sight information acquisition unit 102 (acquisition unit), a viewing angle determination unit 103 (determination unit), a determination unit 104 , a projection control unit 105 , and an operation input unit 106 .

[0118] The communication unit 101 is a functional unit that performs data communication with the projector 200 and the visual line detector 300 via the peripheral connection I / F 715 .

[0119] The line-of-sight information acquisition unit 102 is a functional unit that acquires line-of-sight information of the line of sight of the projection subject 10 detected by the line-of-sight detector 300 through the communication unit 101 .

[0120] The viewing angle determination unit 103 is a functional unit that determines the viewing angle of the projection subject 10 based on the line-of-sight information acquired by the line-of-sight information acquisition unit 102 .

[0121] The determination unit 104 is a functional unit that determines whether the direction of the projection light from the projector 200 is within the viewing angle of the projection subject 10 determined by the viewing angle determination unit 103. The determination unit 104 also determines whether the line of sight of the projection subject 10 is toward the mirror 20 based on the line of sight information acquired by the line of sight information acquisition unit 102.

[0122] The projection control unit 105 is a functional unit that controls the brightness of the projection light of the projector 200. Specifically, when the judgment unit 104 judges that the direction of the projection light is outside the visual angle of the projection subject 10, the projection control unit 105 controls the projection light to be at a normal brightness. Here, the normal brightness refers to, for example, the brightness of the projection mapping for the projection subject 10, which is not subject to any restrictions. On the other hand, when the judgment unit 104 judges that the direction of the projection light is within the visual angle of the projection subject 10, or when the judgment unit 104 judges that the line of sight of the projection subject is toward the direction of the projection light, the projection control unit 105 controls the brightness of the projection light to be darker than the normal brightness.

[0123] Furthermore, when the judgment unit 104 judges that the line of sight of the person being projected 10 is not directed toward the mirror 20, the projection control unit 105 causes the projector 200 to stop irradiating the projection light. There are methods of stopping the irradiation of the projection light, such as setting the light amount of the projection light to zero, extinguishing the light source of the projector 200, shielding the projection light of the projector 200, and the like. Thereafter, when the judgment unit 104 judges that the line of sight of the person being projected 10 is directed toward the mirror 20, the projection control unit 105 causes the projector 200 to start irradiating the projection light again. In this way, the projection light irradiation of the projector 200 can be stopped when it is not needed, and useless power consumption can be reduced.

[0124] The operation input unit 106 is a functional unit that receives operation input from the user. Fig. 9 The keyboard 711 and mouse 712 are shown to implement it.

[0125] The communication unit 101, the line of sight information acquisition unit 102, the viewing angle determination unit 103, the determination unit 104, and the projection control unit 105 are controlled by, for example, Fig. 9 In addition, at least a part of the communication unit 101, the line of sight information acquisition unit 102, the viewing angle determination unit 103, the judgment unit 104 and the projection control unit 105 may also be implemented by a hardware circuit such as an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

[0126] Fig. 9 The functional units of the PC 100 shown in the figure conceptually represent their functions, but the present invention is not limited thereto. Fig. 9 The modules shown are clearly constituted as software modules, and the functions of each functional unit can be realized by executing a program in PC 100. Fig. 9In the PC 100 shown in FIG. 1 , a plurality of functional units shown in FIG. 1 and FIG. 100 are configured as one functional unit. Fig. 9 In the PC 100 shown, the function of one functional unit is divided into a plurality of functions and configured as a plurality of functional units.

[0127] <Projector Setup Procedure>

[0128] Fig.13 FIG. 1 is a flowchart of an example of setting a projector of an image projection system in an embodiment. Fig.13 , describing the setting process of the projector 200.

[0129] <Step S11>

[0130] First, the user sets up the projector 200. Then, the process proceeds to step S12.

[0131] <Step S12>

[0132] Next, the user determines whether the direction of the projection light of the projector 200 is within the viewing angle of the projection subject 10. Alternatively, the line of sight information acquisition unit 102 of the PC 100 acquires the line of sight information through the communication unit 101, the viewing angle determination unit 103 determines the viewing angle of the projection subject 10 based on the line of sight information acquired by the line of sight information acquisition unit 102, the determination unit 104 determines whether the direction of the projection light of the projector 200 is within the viewing angle of the projection subject 10 determined by the viewing angle determination unit 103, and the PC 100 displays the determination result on the display 708. The PC 100 may also display whether the installation position of the projector 200 is appropriate as the determination result. In this case, the installation position of the projector 200 when the direction of the projection light is outside the viewing angle is set as an appropriate installation position. When it is determined that the direction of the projection light of the projector 200 is within the viewing angle of the person 10 (step S12: yes), proceed to step S13, and when it is determined that the direction of the projection light is outside the viewing angle of the person 10 (step S12: no), proceed to step S14.

[0133] <Step S13>

[0134] The user moves the installation position of the projector 200 so that the direction of the projection light of the projector 200 is outside the viewing angle of the projection target person 10. Then, the process proceeds to step S14.

[0135] <Step S14>

[0136] In response to the user's input operation on the operation input unit 106 of the PC 100 , the projector 200 starts irradiating the face of the projection target person 10 or a body part close to the face with projection light, thereby projecting an image.

[0137] <Action flow of controlling projection light brightness in image projection system>

[0138] Fig.14 This is an example of an operation flow chart for controlling the projection light brightness of the image projection system according to the embodiment. Fig.15 FIG. 1 is a timing diagram of an example of an operation flow for controlling the projection light brightness of an image projection system in an embodiment. Fig.14 and Fig.15 , describing the control action flow of projection light brightness in the image projection system 1 of this embodiment.

[0139] First reference Fig.14 , briefly describe the control action of the projection light brightness in the image projection system 1 of this embodiment.

[0140] <Step S21>

[0141] When the image projection system 1 performs projection matching on the projection subject 10, the projection subject 10 moves the line of sight. Then, the process proceeds to step S22.

[0142] <Step S22>

[0143] The sight line detector 300 detects the sight line of the projection subject 10 according to the instruction of the PC 100, and outputs the sight line information of the detected sight line of the projection subject 10 to the PC 100. Then, the sight line information acquisition unit 102 of the PC 100 acquires the sight line information through the communication unit 101. Then, the process proceeds to step S23.

[0144] <Step S23>

[0145] The viewing angle determination unit 103 of the PC 100 determines the viewing angle of the projection subject 10 based on the line of sight information acquired by the line of sight information acquisition unit 102. Then, the determination unit 104 of the PC 100 determines whether the direction of the projection light of the projector 200 is within the viewing angle of the projection subject 10 determined by the viewing angle determination unit 103. When the direction of the projection light of the projector 200 is within the viewing angle of the projection subject 10 (step S23: Yes), the process proceeds to step S24. When the direction of the projection light is outside the viewing angle of the projection subject 10 (step S23: No), the process proceeds to step S25. When the direction of the projection light is outside the viewing angle of the projection subject 10 (step S23: No), if the projection light of the projector 200 is controlled to be darker, the projection control unit 105 returns the projection light of the projector 200 to the original normal brightness.

[0146] <Step S24>

[0147] The projection control unit 105 of the PC 100 controls the brightness of the projection light of the projector 200 to be lower than the normal brightness. Then, the process proceeds to step S25.

[0148] <Step S25>

[0149] The projection control unit 105 causes the projector 200 to start irradiating the face of the projection subject 10 or a body part close to the face with projection light, thereby projecting an image.

[0150] Then, the processing of the above steps S21 to S25 is repeated.

[0151] Next, we will refer to Fig.15 , focusing on the flow of each data, the brightness control operation of the projection light in the image projection system 1 of this embodiment is described in detail.

[0152] <Step S31>

[0153] The operation input unit 106 of the PC 100 receives a detection start input operation on the line of sight detector 300 by the user.

[0154] <Step S32>

[0155] Then, the communication unit 101 of the PC 100 transmits a detection instruction of the line of sight of the projector 10 to the line of sight detector 300. Then, the line of sight detector 300 receives the detection instruction.

[0156] <Steps S33 to S35>

[0157] The sight line detector 300 detects the sight line of the projection subject 10 , and outputs sight line information indicating the detected sight line of the projection subject 10 to the PC 100 .

[0158] <Step S36>

[0159] The viewing angle determination unit 103 of the PC 100 determines the viewing angle of the projection subject 10 based on the line-of-sight information acquired by the line-of-sight information acquisition unit 102 .

[0160] <Step S37>

[0161] The determination unit 104 of the PC 100 determines whether the direction of the projection light of the projector 200 is within the viewing angle of the projection recipient 10 determined by the viewing angle determination unit 103, and the PC 100 displays, for example, on the display 708 whether the projector 200 is in a suitable position so that the projection light direction is outside the viewing angle. If the projection light direction of the projector 200 is within the viewing angle of the projection recipient 10, the process proceeds to step S38, and if the projection light direction is outside the viewing angle of the projection recipient 10, the process proceeds to step S40. In the case where the projection light direction is outside the viewing angle of the projection recipient 10 and the projection light of the projector 200 is controlled to be darker, the projection control unit 105 returns the projection light of the projector 200 to the original normal brightness.

[0162] <Step S38>

[0163] The projection control unit 105 of the PC 100 transmits an instruction for dimming the brightness of the projection light to the projector 200 via the communication unit 101. Then, the projector 200 receives the instruction.

[0164] <Step S39>

[0165] According to the received instruction, the projector 200 makes the brightness of the projection light darker than the normal brightness.

[0166] <Step S40>

[0167] The projection control unit 105 transmits an instruction to project an image by irradiating the projection light toward the face of the projection target 10 or a body part close to the face to the projector 200 via the communication unit 101. Then, the projector 200 receives the instruction.

[0168] <Step S41>

[0169] The projector 200 irradiates the projection light onto the face of the projection target 10 or a body part near the face according to the received instruction, thereby projecting an image.

[0170] Thereafter, the processing of steps S32 to S41 described above is repeated.

[0171] As described above, in the image projection system 1 of the present embodiment, the projector 200 projects an image by irradiating projection light to the projectee 10, the sight line detector 300 detects the sight line of the projectee 10, the PC 100 determines whether the direction of the projection light is within the visual angle of the projectee 10 based on the sight line detected by the sight line detector 300, and the projector 200 displays whether the direction of the projection light is at a suitable position outside the visual angle. In this way, when the image projection device is used to project the image onto a person, the glare felt by the person as the projectee can be reduced.

[0172] The PC 100 in the image projection system 1 of the present embodiment includes: a line of sight information acquisition unit 102 for acquiring line of sight information indicating the line of sight of the projection subject 10 detected by the line of sight detector 300; and a projection control unit 105 for controlling the brightness of the projection light of the projector 200 based on the line of sight information acquired by the line of sight information acquisition unit 102. Specifically, the PC 100 further includes: a view angle determination unit 103 for determining the view angle of the projection subject 10 based on the line of sight information acquired by the line of sight information acquisition unit 102; and a judgment unit 104 for judging whether the direction of the projection light of the projector 200 is within the view angle determined by the view angle determination unit 103. When the judgment unit 104 judges that the direction of the projection light is within the view angle, the projection control unit 105 makes the brightness of the projection light irradiated by the projector 200 darker than the normal brightness. In this way, it is possible to reduce the glare felt by the person as the projection subject when the image projection device is projected onto the person.

[0173] Although the above embodiment is described with the example that the projected object is the projected person (person) and the detected object is the projected person's line of sight, the projected object and the detected object are not limited to this. In addition to the human face, the projected object can also be, for example, a part close to the human face, or an intermediary set between the image projection device and the person. Here, as an example of an intermediary, for example, a face-revealing board in the shape of a billboard used to take commemorative photos can be seen in tourist spots and the like. For example, a face-revealing board that can be used to change the image of the surrounding (background) except for the hole part formed on the board for revealing the face to an arbitrary image. In addition to the line of sight, the detected object can also be set as the part near the eyes or other parts. In the case where the projected person (person) wears glasses, for example, the frame of the glasses can also be set as the detected object. In addition, the application of the above-mentioned image projection system 1 can be, for example, in makeup simulation using mapping, performances on the stage, etc. In addition, even if it is not projected on the face but projected on the body, it will feel dazzling, so it can also be used to map to the body, such as projecting clothes.

[0174] Projector 200 can be used in various occasions, such as business use (projection display for business, conferences, presentations, etc.), home use, medical use (projection display of monochrome medical images such as X-ray images of X-rays and MRI (Magnetic Resonance Imaging) images, etc.), public use (projection display of various guides, advertisements, signs, etc. in public places, stores, and transportation vehicles), and factory installation. Projector 200 has projection modes corresponding to their respective uses (color mode, animation mode, image mode, medical mode for projecting medical images, public mode for projecting guides and signs outdoors or in stores, etc.), and can also automatically change the driving method or driving amount control of light source, power, cooling, output, etc. according to the change of mode.

[0175] In the above-mentioned embodiment, when at least any one of the functional parts of PC100 is implemented by executing a computer program, the computer program is pre-loaded into a ROM or the like and provided. The above-mentioned embodiment can also be configured such that the program executed by PC100 is recorded in a computer-readable recording medium such as a CDROM (Compact Disc Read Only Memory), a floppy disk (FD), a CD-R (Compact Disc-Recordable, recordable optical disk), or a DVD-R (Digital Versatile Disc) in an installable or executable form. The above-mentioned embodiment can also be configured such that the program package executed by PC100 is stored on a computer connected to a network such as the Internet and provided by downloading the program package via the network. The above-mentioned embodiment can also be configured such that the program executed by PC100 is provided or published via a network such as the Internet. In the above-mentioned embodiment, the program executed by PC100 is composed of at least one module of the above-mentioned functional units. As actual hardware, the program is read out from the above-mentioned storage device (such as ROM702, auxiliary storage device 705, etc.) by CPU701 and executed to be loaded onto the main storage device (RAM703) to generate the above-mentioned functional units.

[0176] The aspects of the present invention are as follows.

[0177] <1> An image projection system, comprising:

[0178] An image projection device projects an image by irradiating a projection light onto a projection object;

[0179] a detector for detecting a direction toward which the detected object of the projection object is facing; and

[0180] An information processing device determines whether the direction of the projection light is within a specified angle including the direction of the detection object based on information indicating the direction of the detection object detected by the detector, and displays that the image projection device is at an appropriate position where the direction of the projection light is outside the specified angle.

[0181] <2> according to <1> The image projection system, wherein:

[0182] The information processing device comprises:

[0183] an acquisition unit, configured to acquire information indicating a direction in which the detected object is facing as detected by the detector; and

[0184] The projection control unit is configured to control the brightness of the projection light of the image projection device according to the information acquired by the acquisition unit.

[0185] <3> according to <2> The image projection system, wherein the information processing device further comprises:

[0186] a determination unit configured to determine a predetermined angle including a direction in which the detected object is facing based on the information acquired by the acquisition unit; and

[0187] a judging unit configured to judge whether the direction of the projection light of the image projection device is within the specified angle determined by the determining unit,

[0188] When the determination unit determines that the direction of the projection light is within the predetermined angle, the projection control unit controls the image projection device to make the brightness of the projection light darker than a normal brightness.

[0189] <4> according to <3> In the image projection system, when the determination unit determines that the detected object of the projection object is facing the direction of the projection light, the projection control unit controls the image projection device to make the brightness of the projection light darker than a normal brightness.

[0190] <5> according to <3> or <4> In the image projection system, when the determination unit determines that the direction of the projection light is outside the specified angle, the projection control unit controls the image projection device to return the brightness of the projection light to a normal brightness.

[0191] <6> according to <3> ~ <5> The image projection system as described in any one of the preceding claims, wherein:

[0192] Also includes a mirror arranged opposite to the projected object,

[0193] The judging unit judges whether the detected object of the projection object is facing the mirror based on the information acquired by the acquiring unit,

[0194] When the determination unit determines that the detected object of the projection object is not facing the mirror, the projection control unit controls the image projection device to stop irradiating the projection light.

[0195] <7> according to <6> In the image projection system, when the determination unit determines that the detection object of the projection object is facing the mirror, the projection control unit causes the image projection device to restart irradiating the projection light.

[0196] <8> according to <1> ~ <7> The image projection system described in any one of claims , wherein the projected object is a person being projected.

[0197] <9> according to <8> In the image projection system, the detected object is the line of sight of the person being projected, and the specified angle is the viewing angle of the person being projected.

[0198] <10> An image projection method, comprising:

[0199] An image projection step of projecting an image by irradiating a projection light onto a projection object using an image projection device;

[0200] A detection step, detecting the direction in which the detected object of the projection object is facing; and

[0201] The information processing step determines whether the direction of the projection light is within a specified angle including the direction of the detection object based on the information indicating the direction of the detection object detected by the detector, and the image projection device displays whether the direction of the projection light is at an appropriate position outside the specified angle.

Claims

1. An image projection system, comprising: An image projection device projects an image by irradiating a projection light onto a projection object; A detector, for detecting a direction in which the detected object of the projection object is facing; as well as An information processing device determines whether the direction of the projection light is within a specified angle including the direction of the detection object based on information indicating the direction of the detection object detected by the detector, and displays whether the image projection device is in an appropriate position where the direction of the projection light is outside the specified angle.

2. The image projection system according to claim 1, wherein: The information processing device comprises: an acquisition unit, configured to acquire information indicating a direction in which the detected object is facing as detected by the detector; and The projection control unit is configured to control the brightness of the projection light of the image projection device according to the information acquired by the acquisition unit.

3. The image projection system according to claim 2, wherein: The information processing device further comprises: a determination unit configured to determine a predetermined angle including a direction in which the detected object is facing based on the information acquired by the acquisition unit; and a judging unit configured to judge whether the direction of the projection light of the image projection device is within the specified angle determined by the determining unit, When the determination unit determines that the direction of the projection light is within the predetermined angle, the projection control unit controls the image projection device to make the brightness of the projection light darker than a normal brightness.

4. The image projection system according to claim 3, wherein: When the determination unit determines that the detection object of the projection target faces the direction of the projection light, the projection control unit controls the image projection device to make the brightness of the projection light darker than a normal brightness.

5. The image projection system according to claim 3 or 4, wherein: When the determination unit determines that the direction of the projection light is outside the predetermined angle, the projection control unit controls the image projection device to return the brightness of the projection light to a normal brightness.

6. The image projection system according to claim 3, wherein: Also includes a mirror arranged opposite to the projected object, The judging unit judges whether the detected object of the projection object is facing the mirror based on the information acquired by the acquiring unit, When the determination unit determines that the detected object of the projection object is not facing the mirror, the projection control unit controls the image projection device to stop irradiating the projection light.

7. The image projection system according to claim 6, wherein: When the determination unit determines that the detection object of the projection object is facing the mirror, the projection control unit causes the image projection device to resume irradiating the projection light.

8. The image projection system according to claim 1, wherein: The projected object is the projected person.

9. The image projection system according to claim 8, wherein: The detected object is the line of sight of the projection subject, and the specified angle is the viewing angle of the projection subject.

10. An image projection method, comprising: An image projection step of projecting an image by irradiating a projection light onto a projection object using an image projection device; A detection step of detecting the direction in which the detected object of the projection object is facing; as well as An information processing step is to determine whether the direction of the projection light is within a specified angle including the direction of the detection object based on information indicating the direction of the detection object detected in the detection step, and to display whether the image projection device is in an appropriate position where the direction of the projection light becomes outside the specified angle.

Images