Image projection device, image projection method, and program

Abstract

To prevent deterioration in convenience of a user when an image is projected with an object included in a projection surface being concealed.SOLUTION: An image projection device 100 having a projection unit 160 that projects an image onto a projection surface such as a wall surface includes a switching unit 153 that switches a first projection image projected by the projection unit 160 to a second projection image that allows a user to recognize an object in a case where predetermined conditions are satisfied when the projection unit 160 is projecting the first projection image onto the projection surface such that the object such as a door included in the projection surface is hidden.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an image projection device, an image projection method, and a program. [Background technology]

[0002] When an image is projected onto a projection surface such as a wall surface 1, which is not a dedicated screen, problems arise in that the image is projected in a hue different from the original hue or in a distorted form due to the influence of the pattern, color, and unevenness of the projection surface. To address these problems, Patent Document 1 discloses a projection method in which an image corrected using correction parameters to cancel out the color pattern of the projection surface is projected onto the projection surface. Patent Document 2 also discloses a projection method in which a distorted projected image is corrected to produce a rectangular projected image when projected onto an irregularly wavy curved projection surface. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-235158 [Patent Document 2] Japanese Patent Publication No. 2022-146113 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, when projecting an image onto a wall surface 1 on which a door is installed, the projection methods disclosed in Patent Documents 1 and 2 can be used to project an image in which the door is concealed, making the presence of the door less or not noticeable, thereby achieving good image projection. However, this can make it difficult for the user to find the door, which can reduce user convenience.

[0005] The present invention has been made in consideration of the above-mentioned situation, and aims to provide an image projection device, an image projection method, and a program that can prevent a decrease in user convenience when projecting an image by concealing objects included on the projection surface. [Means for solving the problem]

[0006] In order to achieve the above object, an image projection device according to the present invention comprises: An image projection device including a projection unit that projects an image onto a projection surface, a switching unit that switches the first projection image projected by the projection unit to a second projection image that allows a user to recognize the object when a predetermined condition is met while the projection unit is projecting a first projection image onto the projection surface so that the object included in the projection surface is concealed; Equipped with. [Effects of the Invention]

[0007] According to the present invention, it is possible to prevent a decrease in user convenience when an image is projected by concealing an object included in the projection surface. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram schematically illustrating a situation in which an image projection device according to an embodiment of the present invention is used; [Figure 2] FIG. 10 is a diagram showing an example of a door included in a wall surface. [Figure 3] 1 is a block diagram showing a configuration of an image projection device according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing an example of a first image according to an embodiment of the present invention. [Figure 5] FIG. 4 is a diagram showing an example of a second image according to an embodiment of the present invention. [Figure 6] 10 is a flowchart of an image projection process according to an embodiment of the present invention. [Figure 7] FIG. 10 is a diagram showing an example of a first image projected onto a wall surface without correction. [Figure 8] FIG. 10 is a diagram showing an example of a first image corrected and projected onto a wall surface. [Figure 9] FIG. 10 is a diagram showing an example of a second image corrected and projected onto a wall surface. [Figure 10] FIG. 10 is a diagram showing an example of a second image projected onto a wall surface without correction. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an image projection device, an image projection method, and a program according to an embodiment of the present invention will be described in detail with reference to the drawings. Note that the same or corresponding parts in the drawings are designated by the same reference numerals.

[0010] FIG. 1 is a diagram illustrating a typical usage scenario of an image projection device 100 according to an embodiment of the present invention. The image projection device 100 is a component of an image projection system AA. The image projection device 100 is installed, for example, in a store. It projects an image of a landscape or the like onto a wall surface 1 as a projection surface to enhance aesthetic appeal. A restroom door 2 is provided on the wall surface 1. As shown in FIG. 2, the door 2 is decorated with numerous diamond-shaped patterns 21 and a recess 22 below. The door 2 also has a doorknob 23. Therefore, the wall surface 1 including the door 2 is inherently less suitable as a projection surface for an image than a dedicated screen. The image projection device 100 is also connected to a PC (Personal Computer) 10, an imaging device 20, and a motion sensor 30, which are other components of the image projection system AA. The PC 10, imaging device 20, and motion sensor 30 may be integrated into a single device.

[0011] The PC 10 is a computer that supplies image data of an image to be projected to the image projection device 100 and remotely operates the image projection device 100. The image projection device 100 may project image data that it holds.

[0012] The imaging device 20 is a camera that captures the entire wall surface 1 that is the projection surface of the image projection device 100. The position and angle of view of the imaging device 20 are adjusted in advance so that the range captured by the imaging device 20 and the range projected by the image projection device 100 are approximately the same. The imaging device 20 may be installed integrally with the image projection device 100.

[0013] The human presence sensor 30 is, for example, a pyroelectric infrared sensor, and is installed near the wall surface 1. The human presence sensor 30 detects the presence of a person around the wall surface 1.

[0014] Next, a description will be given of the configuration of the image projection device 100. As shown in Fig. 3, the image projection device 100 includes an interface unit (referred to as an IF unit in the drawing) 110, an input unit 120, a memory 130, an image selector 140, a control unit 150, and a projection unit 160.

[0015] The interface unit 110 is an interface for connecting an external device to the image projection device 100, and includes, for example, a USB port. The interface unit 110 outputs a signal received from the external device to the control unit 150, and transmits a signal output from the control unit 150 to the external device. In this embodiment, the PC 10, the imaging device 20, and the human presence sensor 30 are connected to the image projection device 100 by the interface unit 110 as the external devices.

[0016] The input unit 120 includes various buttons, accepts an input operation from the user, and outputs a signal corresponding to the accepted input operation to the control unit 150.

[0017] The memory 130 is, for example, a readable / writable nonvolatile flash memory or the like, and stores various types of data. The memory 130 also has a first image storage area 131 and a second image storage area 132 as storage areas in which image data of images to be projected onto the wall surface 1 by the projection unit 160 is stored.

[0018] The first image storage area 131 stores image data of an original image (hereinafter referred to as the first image or original image) that is to be mainly projected onto the wall surface 1. An example of the first image is shown in FIG. 4. In this example, the first image is a landscape image that is projected onto the wall surface 1 for the purpose of improving the aesthetic appeal of the store. In the specific examples described below, the image shown in FIG. 4 will be described as the first image unless otherwise specified.

[0019] The second image storage area 132 stores image data of an image (hereinafter referred to as the second image) that is projected in place of the first image when the motion sensor 30 detects a person. An example of the second image is shown in FIG. 5. The second image is an image that allows the user to recognize a toilet door 2, which is an object included on the wall surface 1 that is the projection surface, and in this example, is an image consisting of a toilet symbol and the word "TOILET" underneath it. Note that FIG. 5 is just one example, and various designs of the second image can be adopted as long as they allow the user to recognize the toilet door 2. Furthermore, in the specific examples described below, the image shown in FIG. 5 will be described as the second image unless otherwise specified.

[0020] 3, the image selector 140 is a switch for selecting either the first image storage area 131 or the second image storage area 132. A correction unit 152, which will be described later, acquires the first image or the second image from the first image storage area 131 or the second image storage area 132 selected by the image selector 140, and performs correction to conceal the door 2.

[0021] The control unit 150 includes a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores an operating program for the CPU to operate, a RAM (Random Access Memory) that serves as a work area for the CPU, and the like, and controls the entire image projection device 100. The CPU executes the operating program, causing the control unit 150 to function as an image data acquisition unit 151, a correction unit 152, and a switching unit 153.

[0022] The image data acquisition unit 151 acquires image data of the first image and image data of the second image from the PC 10 via the interface unit 110, and stores them in the first image storage area 131 and the second image recording area of ​​the memory 130, respectively.

[0023] Correction unit 152 corrects the image stored in the image storage area currently selected by image selector 140 so that door 2 is concealed when the image is projected onto wall surface 1, and inputs the image data of the corrected image to projection unit 160. As described above, door 2 has patterns, recesses, and a doorknob (see FIG. 2), and therefore, if the image is projected directly onto wall surface 1 that includes door 2, it will be affected by these and the hue will change and visibility will deteriorate. By correcting the image using correction unit 152, door 2 is concealed when projected onto wall surface 1, and the image can be projected satisfactorily.

[0024] Specifically, the correction unit 152 performs color conversion correction and geometric deformation correction on the image. The color conversion correction is a correction that converts the color of the first image so that the color of the pattern, etc. of the door 2 is canceled when the image is projected onto the door 2. The color conversion correction can be performed using a known method, for example, as described in Patent Document 1. The geometric deformation correction is a correction that transforms the position within the first image so that the unevenness of the door 2 is canceled when the first image is projected onto the door 2. The geometric deformation correction can be performed using a known method, for example, as described in Patent Document 2. In this way, by performing the color conversion correction and the geometric deformation correction, an image that looks the same as the image that would be projected onto the area of ​​the wall 1 where the door 2 is actually installed is projected onto that area if the door 2 were not installed. This makes it difficult to recognize the boundary between the area of ​​the wall 1 where the door 2 is installed and the other areas, and the door 2 is concealed.

[0025] The switching unit 153 controls the image selector 140 to switch the image corrected by the correction unit 152 and projected from the projection unit 160. Specifically, if the motion sensor 30 detects a person while the projection unit 160 is projecting the first image (first projection image) corrected by the correction unit 152, the switching unit 153 switches the selection target of the image selector 140 to the second image storage area 132. This allows the image projected by the projection unit 160 to be switched to the corrected second image (second projection image). Furthermore, when a predetermined time has elapsed since the projection unit 160 projected the second projection image, the switching unit 153 switches the selection target of the image selector 140 to the first image storage area 131. This allows the image projected by the projection unit 160 to be switched to the first projection image. Note that the image selector 140 may not be provided, and the switching unit 153 may switch the image to be projected by software processing.

[0026] The projection unit 160 includes a display element such as a DMD (Digital Mirror Device), and projects the first image or the second image corrected by the correction unit 152 onto the wall surface 1. In the following description, the corrected first image projected onto the wall surface 1 by the projection unit 160 will also be referred to as the first projected image. The corrected second image projected onto the wall surface 1 by the projection unit 160 will also be referred to as the second projected image.

[0027] Next, a description will be given of the operation of the image projection device 100. When the image projection device 100 is started up or when a user instructs the start of processing via the input unit 120 or the PC 10, the image projection processing shown in FIG.

[0028] First, image data acquisition unit 151 acquires a first image and a second image from PC 10 via interface unit 110, and stores the first image in first image storage area 131 and the second image in second image storage area 132 (step S101). Note that if the first image and the second image have already been stored in first image storage area 131 and second image storage area 132 because data from the previous image projection process remains, for example, step S101 may be omitted.

[0029] Next, the correction unit 152 acquires a captured image of the wall surface 1 including the door 2, which is to be used as the projection surface, from the image capture device 20 via the interface unit 110 (step S102).

[0030] Next, the correction unit 152 analyzes the acquired captured image, generates color conversion correction data, which is data for color conversion correction to cancel out the color of the door 2, and stores the data in the memory 130 (step S103). Specifically, the correction unit 152 analyzes the image captured by the imaging device 20, detects the door 2 in the captured image, and acquires color information of the door 2 for each pixel. Based on the acquired color information, the correction unit 152 then generates color conversion correction data for canceling out the color of the door 2 to an achromatic color or the same color as the surrounding walls. Specifically, the color conversion correction data here is image data of the door 2 in which the hue of the door 2 is converted to a complementary color (e.g., green parts are converted to magenta) and the brightness is converted inversely (e.g., bright parts are converted to darker and dark parts are converted to brighter). Projecting this image data onto the door 2 cancels out the colors of the pattern 21 and the like on the door 2. Note that the color conversion correction data does not necessarily have to be this kind of image data, and may be data in which the above-mentioned hue and brightness conversion formulas and conversion parameters are defined for each pixel.

[0031] Next, the correction unit 152 analyzes the acquired captured image, generates geometric transformation correction data, which is data for performing geometric transformation correction to cancel out unevenness of the door 2, and stores the data in the memory 130 (step S104). Specifically, the correction unit 152 analyzes the image captured by the imaging device 20, detects the door 2 from the image, and acquires the reflectance of each color of the portion corresponding to the door 2 for each pixel, and understands the unevenness of the door 2 from the reflectance. The correction unit 152 then generates, as geometric transformation correction data, image data of the door 2 that has been transformed so that the larger the dent in the door 2 is, the larger the portion of the door 2 that is deformed. Note that the geometric transformation correction data does not necessarily have to be this type of image data, and may be data that defines the content of the above-mentioned transformation process for each pixel, etc.

[0032] It should be noted that steps S103 and S104 do not necessarily have to be performed in this order, and step S103 may be performed after step S104, or step S103 and step S104 may be performed simultaneously.

[0033] Next, the switching unit 153 controls the image selector 140 to select the first image storage area 131 (step S105). As a result, the first image in the first image storage area 131 is input to the correction unit 152 via the image selector 140.

[0034] Next, correction unit 152 corrects the first image using the color conversion correction data and geometric transformation correction data generated in steps S103 and S104 so that door 2 is concealed when projected onto the projection surface (step S106). Specifically, correction unit 152 corrects the first image by combining the image indicated by the color conversion correction data and the image indicated by the geometric transformation correction data with the first image.

[0035] Next, projection unit 160 projects the first image (first projection image) corrected by correction unit 152 onto wall surface 1 (step S107). If the first image is projected onto wall surface 1 without correction, it will be affected by the pattern 21, recess 22, doorknob 23, etc. of door 2, as shown in Fig. 7, and the first image will not be projected properly. In contrast, in step S107, the corrected first image is projected, and therefore door 2 inside wall surface 1 is concealed, as shown in Fig. 8, and the first image can be projected properly.

[0036] 6, the control unit 150 then acquires the detection result of the human presence sensor 30 via the interface unit 110 and determines whether or not a person has been detected around the wall surface 1 (step S108). If no person has been detected (step S108; No), the process returns to step S107, and the projection of the corrected first image continues.

[0037] On the other hand, if a person is detected (step S108; Yes), the switching unit 153 controls the image selector 140 to select the second image storage area 132 (step S109). As a result, the second image in the second image storage area 132 is input to the correction unit 152 via the image selector 140.

[0038] Next, the correction unit 152 corrects the second image using the color conversion correction data and the geometric transformation correction data generated in steps S103 and S104 so that the door 2 is concealed when projected onto the projection surface (step S110). Then, the projection unit 160 projects the second image (second projected image) corrected by the correction unit 152 onto the wall surface 1 instead of the first image (step S111). FIG. 9 shows an example of the projection of the second image in step S111. This allows a user around the wall surface 1 detected by the motion sensor 30 to immediately know that the previously concealed toilet door 2 is actually on the wall surface 1.

[0039] 6, the control unit 150 then determines whether a predetermined time (for example, 10 seconds) has elapsed since the second image was projected (step S112). If the predetermined time has not elapsed (step S112; No), the process returns to step S111, and the projection of the corrected second image continues.

[0040] On the other hand, if the predetermined time has elapsed (step S112; Yes), the process returns to step S105, and the first image stored in the first image storage area 131 is corrected so that the door 2 is concealed, and the process of projecting the first image onto the wall surface 1 is performed again. Note that if the user is no longer detected by the motion sensor 30, or if a predetermined time has elapsed since the user was no longer detected by the motion sensor 30, the process returns to step S105, and the process of correcting the first image stored in the first image storage area 131 so that the door 2 is concealed, and the process of projecting the first image onto the wall surface 1 may be performed again.

[0041] Thus, according to this embodiment, when the first image is corrected and projected so as to conceal the door 2, which is an object included in the wall surface 1 that is the projection surface, and the motion sensor 30 detects a person around the wall surface 1, the projected image is switched to the second image that allows the user to recognize the concealed door 2. Therefore, the user can recognize the door 2 that is normally concealed, and it is possible to prevent a decrease in user convenience when an image is projected by concealing an object included in the projection surface.

[0042] (Variation) The above embodiment can be modified and applied in various ways. For example, in the above embodiment, the image projection device 100 that projects a still image has been described, but similar processing is possible when projecting images continuously. That is, in the present invention, projecting an image can include projecting a moving image, which is a continuous image.

[0043] In the above embodiment, the object to be concealed when an image is projected is the door 2, but the object to be concealed is not limited to the door 2. For example, the object may be a three-dimensional object such as furniture included in the wall surface 1 that serves as the projection surface. In this case as well, the first image is normally projected while concealing the three-dimensional object, and when a person is detected by the motion sensor 30, the image is switched to the second image that makes the user aware of the presence of the three-dimensional object. Furthermore, the projection surface is not limited to the wall surface 1, and the image may be projected onto the ceiling, floor, etc.

[0044] In the above embodiment, the projected image is switched from the first image to the second image when the condition that the motion sensor 30 has detected a person is met, but the condition for switching to the second image is not limited to this. For example, in a store or the like where live music is performed, the first image may be projected onto the wall surface 1 under normal circumstances, and when a specific timing occurs, such as a break in the live music, the condition is met and the projected image may be switched from the first image to the second image. In this case, the projected image may also be switched back to the first image when the break ends.

[0045] In the above embodiment, the second image corrected to conceal the door 2 is projected onto the wall surface 1 as shown in Fig. 9. However, since the second image only needs to enable the user to recognize the door 2, the second image may be projected onto the wall surface 1 as the second projected image without concealing the door 2 as shown in Fig. 10. Alternatively, the first image (original image) not corrected to conceal the door 2 may be projected onto the wall surface 1 as the second projected image as shown in Fig. 7. In this case, there is no need to separately store image data of the second image, so the second image storage area 132 is unnecessary, and the storage capacity of the memory 130 can be saved.

[0046] In the above embodiment, the correction unit 152 performs two types of correction, color conversion correction and geometric deformation correction, to conceal the door 2. However, only one of these corrections may be performed. As an example, image processing may be performed to detect a pattern on the image of the door 2. If a pattern is detected, color conversion correction may be performed to cancel the detected pattern, while no color conversion correction may be performed if no pattern is detected. Alternatively, image processing may be performed to detect irregularities on the image of the door 2. If irregularities are detected, geometric deformation correction may be performed to cancel the detected irregularities, while no geometric deformation correction may be performed if no irregularities are detected. Alternatively, the user may be allowed to specify whether to perform color conversion correction and geometric deformation correction. Furthermore, the correction unit 152 may receive a specification of the type of correction from the input unit 120 or the PC 10, and perform only the specified type of correction.

[0047] Furthermore, a computer capable of realizing each of the above-described functions may be configured by storing and distributing a program for realizing each of the functions in the control unit 150 of the image projection device 100 on a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory) or a DVD-ROM (Digital Versatile Disc Read Only Memory), and installing the program on the computer. When each function is realized by sharing the work between an OS and an application, or by cooperation between an OS and an application, only the application may be stored on the recording medium.

[0048] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to such specific embodiments, and the present invention includes the inventions described in the claims and their equivalents. [Explanation of symbols]

[0049] 1 Wall, 2 Door, 21 Pattern, 22 Recess, 23 Doorknob, 10 PC, 20 Imaging device, 30 Human presence sensor, 100 Image projection device, 110 Interface unit, 120 Input unit, 130 Memory, 131 First image recording area, 132 Second image recording area, 140 Image selector, 150 Control unit, 151 Image data acquisition unit, 152 Correction unit, 153 Switching unit, 160 Projection unit, AA Image projection system

Claims

1. An image projection device including a projection unit that projects an image onto a projection surface, a switching unit that switches the first projection image projected by the projection unit to a second projection image that allows a user to recognize the object when a predetermined condition is met while the projection unit is projecting a first projection image onto the projection surface so that the object included in the projection surface is concealed; An image projection device comprising:

2. an image data acquisition unit that acquires image data of an original image; a correction unit that corrects the original image so that an object included in the projection plane is hidden, the first projection image is an image obtained by correcting the original image by the correction unit; The image projection device according to claim 1 .

3. the predetermined condition is a condition that is met when a person is detected around the projection surface. The image projection device according to claim 1 .

4. The predetermined condition is a condition that is met when a predetermined timing is reached. The image projection device according to claim 1 .

5. the switching unit switches the image to be projected on the projection surface to the first projection image when a predetermined time has elapsed after switching the image to the second projection image, The image projection device according to claim 1 .

6. the projection unit projects the original image onto the projection surface as the second projected image. The image projection device according to claim 2 .

7. An image projection method for projecting an image onto a projection surface, comprising: when a predetermined condition is met while a first projection image is being projected onto the projection surface so as to conceal an object included in the projection surface, the first projection image being projected is switched to a second projection image that allows a user to recognize the object; Image projection method.

8. Computer, a switching unit that switches the first projection image projected by the projection unit to a second projection image that allows a user to recognize the object when a predetermined condition is met while the projection unit, which projects an image onto a projection surface, projects a first projection image onto the projection surface so that an object included in the projection surface is concealed; A program that functions as a

Images