METHOD FOR CONTROLLING PROJECTOR AND PROJECTOR

Abstract

To improve convenience of drawing performed by a user with an indicator.SOLUTION: A method for controlling a projector 100 includes: indicating, by the projector 100, a drawing area 20 for receiving drawing performed by a first indicator 50 and projecting, by the projector 100, an area image 21 in an achromatic color on a projection surface 10 at first brightness B1 being at a specific ratio or less to the maximum brightness of the image that the projector can project on the projection surface 10; while the area image 21 is projected, detecting a position PS on the projection surface 10 indicated by the first indicator 50; determining whether the position PS is included in the drawing area 20; and when determining that the position PS is included in the drawing area 20, displaying an area including at least a part of a contour 210 of the drawing area 20 by using the projector 100 at brightness higher than the first brightness B1 of the area image 21.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a method for controlling a projector and a projector. [Background technology]

[0002] 2. Description of the Related Art Techniques for projecting images onto a whiteboard or blackboard are known. For example, the video information terminal device described in Patent Document 1 displays a reservation list including information related to the reservation time, reservation holder, and content of the conference room on the video display unit via the video output unit. The video information terminal device also displays the digital minutes obtained by capturing the video display unit with inverted brightness if the video display unit is a whiteboard, and displays the digital minutes with a transparent background if the video display unit is a blackboard or the like. The projection system described in Patent Document 2 includes a light emitting device that emits detection light to a detection area where a pointing position of a pointer is detected, and a projector that detects the pointing position of the pointer in the detection area. The projector includes an imaging unit that captures an image of the detection area, and a position detection unit that detects the pointing position of the pointer based on image data captured by the imaging unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-97852 A [Patent Document 2] JP 2018-160265 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, for example, when the background is displayed transparently as described in Patent Document 1, as described in Patent Document 2, it may become difficult for the user to draw with the pointer, for example, because the captured image generated by the imaging unit capturing an image of the detection area makes it impossible to detect the drawing area that accepts drawing with the pointer. [Means for solving the problem]

[0005] One aspect of the present disclosure is a method of controlling a projector that includes projecting onto a projection surface an achromatic area image indicating a drawing area in which the projector accepts drawing by a pointer, at a first luminance that is a specific percentage or less of a maximum luminance that the projector can project onto the projection surface; detecting a position on the projection surface indicated by the pointer while projecting the area image; determining whether the position is included in the drawing area; and if it is determined that the position is included in the drawing area, displaying an area including at least a portion of the outline of the drawing area at a luminance higher than the first luminance.

[0006] Another aspect of the present disclosure is a projector that includes a light source, a light modulation device that emits image light by modulating light from the light source, a detection device that detects a position of a projection surface indicated by a pointer, and a control unit that controls the light modulation device and the detection device, wherein the control unit causes the light modulation device to project onto the projection surface an achromatic area image indicating a drawing area that accepts drawing by the pointer at a first luminance that is equal to or less than a specific percentage of a maximum luminance that can be projected onto the projection surface, causes the detection device to detect the position of the projection surface indicated by the pointer while projecting the area image, determines whether the position is included in the drawing area, and, if it is determined that the position is included in the drawing area, causes the light modulation device to display an area including at least a portion of the contour of the drawing area at a luminance higher than the first luminance. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a perspective view showing an example of the configuration of a projection system. [Diagram 2] FIG. 1 is a side view showing an example of a projection system. [Diagram 3] FIG. 2 is a diagram showing an example of the configuration of a projector and a first indicator according to the embodiment. [Figure 4] 5A to 5C are views showing examples of a drawing region and a specific region in the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of display of a portion of a contour overlapping a specific region in the first embodiment. [Figure 6] FIG. 4 is a diagram showing an example of display of a portion of a contour overlapping a specific region in the first embodiment. [Figure 7] 6 is a flowchart showing an example of a contour display process of the first control unit in the first embodiment. [Figure 8] 13A to 13C are views showing an example of a luminance change process of a drawing area in the second embodiment. [Figure 9] 10 is a flowchart showing an example of a luminance change process of a first control unit in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, the present embodiment will be described with reference to the drawings. Note that the present embodiment includes a first embodiment that will be described with reference to Figs. 5 to 7, and a second embodiment that will be described with reference to Figs. 8 and 9.

[0009] [1. Configuration of Projection System 1] FIG. 1 is a perspective view showing an example of the configuration of a projection system 1. As shown in FIG. The projection system 1 includes a projector 100, a projection surface 10, and a first pointer 50. The projection surface 10 is a surface onto which the projector 100 projects an image. The first pointer 50 is used by a user to point to a position PS on the projection surface 10. The position PS on the projection surface 10 can also be specified by a second pointing object 70 such as the user's finger. FIG. 1 shows an X-axis, a Y-axis, and a Z-axis which are orthogonal to each other. The Z-axis indicates a direction parallel to the normal direction of the projection surface 10. The Y-axis indicates a direction parallel to the vertical direction. The X-axis indicates a direction perpendicular to each of the Z-axis and the Y-axis. Hereinafter, the positive direction of the Z-axis may be referred to as "forward". The positive direction of the Y-axis may be referred to as "downward". The positive direction of the X-axis may be referred to as "rightward".

[0010] The projector 100 generates image light corresponding to image data, and projects the generated image light onto the projection surface 10. The projector 100 also has a so-called "interactive function." The "interactive function" is a function that detects a position PS on the projection surface 10 indicated by the first indicator 50 or the second indicator 70, and displays an image corresponding to the position PS or the trajectory of the first indicator 50 or the second indicator 70 on the projection surface 10 based on the detected position PS, or modifies the image displayed on the projection surface 10.

[0011] The first indicator 50 is a pen-shaped indicator that is held by the user and has a light-emitting tip 51, a shaft 52 that is gripped by the user, and the like. A light-emitting unit 55 such as an LED (Light Emitting Diode) that emits near-infrared light is mounted on the tip 51. The light-emitting unit 55 emits light at a predetermined light-emitting interval when the tip 51 is in contact with the projection surface 10. The light-emitting unit 55 also emits light at a predetermined light-emitting interval even when the tip 51 is not in contact with the projection surface 10. Although one first indicator 50 is shown in FIG. 1, the number of first indicators 50 that can be used simultaneously is not limited to one, and a plurality of first indicators 50 can also be used simultaneously. The first indicator 50 corresponds to an example of an "indicator." The first indicator 50 will be further described with reference to FIG.

[0012] Furthermore, when using the user's finger as the second indicator 70, the user touches the tip of the finger or the like to the projection surface 10 to indicate a position PS on the projection surface 10. The projector 100 emits detection light along the projection surface 10, and when the tip of the second pointer 70 comes into contact with the projection surface 10, the detection light is blocked. This detection light is hereinafter referred to as second light 180. The second light 180 is reflected by the second pointer 70, and a portion of the reflected light of the second light 180 travels from the second pointer 70 toward the projector 100. The projector 100 detects the reflected light of the second light 180 reflected by the second pointer 70, and detects the position PS indicated by the second pointer 70. The second indicator 70 corresponds to an example of an "indicator." That is, in this embodiment, the “indicator” includes a first indicator 50 and a second indicator 70.

[0013] FIG. 2 is a side view showing an example of the projection system 1. As shown in FIG. In this embodiment, the projector 100 is fixed to a wall surface, for example, and installed in front of and above the projection surface 10. The projector 100 projects image light toward the projection surface 10 diagonally below the projector 100. The drawing area 20 is an area of ​​the projection surface 10 onto which the image light is projected by the projector 100. The projector 100 accepts drawing by a pointer in the drawing area 20. In addition, the projector 100 irradiates second light 180 used to detect the first pointer 50 and the second pointer 70 in a direction corresponding to the projection surface 10.

[0014] The direction in which the second light 180 is irradiated is, for example, a direction in which the reflected light reflected by the second indicator 70 approaching within a predetermined distance from the projection surface 10 can be incident on the imaging unit 135. The second light 180 is light used to detect the position PS of the second indicator 70, and is infrared light in this embodiment. Since the second light 180 is infrared light, the second indicator 70 can be detected without being affected by image light mainly composed of visible light, and does not affect the display by the image light. The second light 180 is irradiated to a range including at least a part of the projection surface 10. In this embodiment, the second light 180 is projected, for example, to a range covering the entire projection surface 10. The second light 180 is further described with reference to FIG.

[0015] [2. Configuration of the projector 100 and the first indicator 50] FIG. 3 is a diagram showing an example of the configuration of the projector 100 and the first indicator 50. As shown in FIG. First, a description will be given of the configuration of the projector 100. The projector 100 includes an image generating section 110, a projection section 120, a transmission section 131, an irradiation section 133, an imaging section 135, a light receiving section 140, and a first control section 150.

[0016] The image generation unit 110 is an information processing device including a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The image generation unit 110 has an image storage unit 115 that stores an image projected by the projection unit 120. The image storage unit 115 is a so-called "frame memory" that stores the image projected by the projection unit 120 in units of frames. In the following description, the image projected by the projection unit 120 may be referred to as a "projected image".

[0017] The image generation unit 110 draws a projection image to be projected on the projection surface 10 in the image storage unit 115 based on image data. The image generation unit 110 outputs an image signal indicating the image drawn in the image storage unit 115 to the light modulation device 123 described later, and causes the light modulation device 123 to output image light corresponding to the image data. The image light generated by the light modulation device 123 is projected by the projection unit 120 onto the projection surface 10.

[0018] Furthermore, the image generation unit 110 executes image processing on the image to be drawn in the image storage unit 115. For example, the image generation unit 110 executes a geometric correction process for correcting trapezoidal distortion and the like in the drawing area 20, a digital zoom process for enlarging or reducing the size of the image to be displayed on the projection surface 10, a color correction process for correcting the color tone and the like of the image to be displayed on the projection surface 10, and the like.

[0019] The projection unit 120 includes a light source 121 , a light modulation device 123 , and an optical unit 125 .

[0020] The light source 121 includes a light source such as a xenon lamp, an extra-high pressure mercury lamp, an LED, a laser light source, etc. The light source 121 may also include a reflector and an auxiliary reflector that guide the light emitted from the light source to the light modulation device 123.

[0021] The light modulation device 123 includes a modulation element such as a liquid crystal panel. The light modulation device 123 forms image light by modulating the light incident from the light source 121 in accordance with an image signal input from the image storage unit 115. The image light is typically color image light including three colors of visible light, red (R), green (G), and blue (B). In this embodiment, the light modulation device 123 is described as having a modulation element such as a liquid crystal panel, but is not limited thereto. The light modulation device 123 may be a so-called DLP (Digital Light Processing) type having a DMD (Digital Mirror Device).

[0022] The optical unit 125 projects the image light formed by the light modulation device 123 onto the projection surface 10 to form an image on the projection surface 10. The optical unit 125 includes at least one of a lens and a mirror. The optical unit 125 may include a zoom mechanism that enlarges or reduces the image projected onto the projection surface 10, and a focus adjustment mechanism that adjusts the focus.

[0023] The transmitting unit 131 outputs signal light 170 which is a signal for synchronizing the light emission timing of the first indicator 50 with the imaging timing of the imaging unit 135. The signal light 170 is indicated by a two-dot chain line in Fig. 3. The signal light 170 is, for example, a near-infrared light signal that can be received by the receiving unit 53. When the projector 100 is in an activated state, the transmitting unit 131 transmits the signal light 170 at predetermined time intervals.

[0024] The signal light 170 indicates, for example, a control signal that specifies the timing for causing the first indicator 50 to transmit the first light 190. The first light 190 is near-infrared light having a predetermined emission pattern. In Fig. 3, the first light 190 is indicated by a dashed dotted line. The first indicator 50 transmits the first light 190 in synchronization with the timing of receiving the signal light 170, for example. In this way, the projector 100 can cause the imaging unit 135 to capture an image in synchronization with the timing at which the first indicator 50 emits the first light 190. The transmission unit 131 includes, for example, a light source such as an LED, and a device that controls turning the light source on and off. The device that controls turning the light source on and off can be configured, for example, by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or the like.

[0025] The irradiation unit 133 irradiates a second light 180 for detecting the first indicator 50 and the second indicator 70 in a direction including the projection surface 10. In FIG. 3, the second light 180 is indicated by a dashed line. The irradiation unit 133 has an LD (Laser Diode) or an LED as a light source that outputs infrared light. The irradiation unit 133 may also include an optical component that diffuses the infrared light output by the light source toward the projection surface 10.

[0026] The imaging unit 135 is a camera equipped with an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) that receives near-infrared light outputted by the light emitting unit 55 of the first indicator 50. The imaging unit 135 also includes an optical system that forms an image on the imaging element, an aperture that limits the amount of light incident on the imaging element, and the like. The imaging section 135 captures an image of a range including the projection surface 10 and generates a captured image. The imaging section 135 receives and captures the first light 190 outputted by the first indicator 50. The captured image generated by the imaging section 135 is outputted to the first control section 150. The imaging unit 135 corresponds to a part of the “detection device”.

[0027] When capturing an image, the imaging section 135 outputs an interrupt signal to the first control section 150. When the imaging section 135 receives a response corresponding to the interrupt signal from the first control section 150, the imaging section 135 outputs the captured image to the first control section 150.

[0028] The light receiving unit 140 receives an infrared signal transmitted from the remote control 5. The light receiving unit 140 generates an operation signal corresponding to the received infrared signal, and outputs the generated operation signal to the first control unit 150. The operation signal is a signal corresponding to a switch on the remote control 5 operated by the user.

[0029] The first control unit 150 is a computer device including a memory 160B and a processor 160A. The memory 160B includes, for example, a volatile memory such as a random access memory (RAM) and a non-volatile memory such as a read only memory (ROM). The volatile memory constitutes a work area for the processor 160A. The non-volatile memory stores the control program executed by the processor 160A and the calibration data 166. The control program includes firmware and an application program 165. The first control unit 150 corresponds to an example of a "control unit."

[0030] The calibration data 166 is data that associates the captured image with the drawing area 20 of the projection surface 10. Specifically, the calibration data 166 is data that associates the coordinates of each pixel in the coordinate system of the captured image with the coordinates of each pixel in the coordinate system of the image storage unit 115. In this embodiment, the coordinates of the captured image are referred to as "camera coordinates," and the coordinates of the image storage unit 115 are referred to as "panel coordinates." By referring to the calibration data 166, a corresponding position PS in the drawing area 20 is uniquely identified for one position on the captured image.

[0031] The application programs 165 are programs executed by the processor 160A. The application programs 165 include programs that realize interactive functions.

[0032] The processor 160A is configured, for example, by a CPU, a MPU (Micro Processor Unit), etc. The processor 160A executes a control program to control each unit of the projector 100. The processor 160A may be configured by a plurality of processors.

[0033] The first control unit 150 detects the first light 190 captured in the captured image and the reflected light of the second light 180 reflected by the first indicator 50. The first control unit 150 analyzes the captured image generated by the imaging unit 135 to identify the positions PS indicated by the first indicator 50 and the second indicator 70. The first control unit 150 generates coordinate information indicating the positions of the light points of the detected first light 190 and the light points of the reflected light of the second light 180. The coordinate information is expressed in camera coordinates. These processes by the first control unit 150 are executed by, for example, the detection unit 162 described later.

[0034] The first control unit 150 converts the coordinate information expressed in the camera coordinate system into coordinate information in the panel coordinate system. This conversion is performed, for example, based on the calibration data 166 generated by a calibration performed in advance.

[0035] The first control unit 150 controls each unit of the projector 100 to display an image on the projection surface 10. Also, the first control unit 150 generates drawing data representing images, figures, characters, symbols, etc. corresponding to the trajectory of the position PS on the projection surface 10 indicated by the first indicator 50 and the second indicator 70. The first control unit 150 outputs the generated drawing data to the image generation unit 110. The first control unit 150 controls the image generation unit 110 to develop the image data at coordinates on the image storage unit 115 based on the converted coordinate information. As a result, the drawing data is superimposed on the image data and displayed on the projection surface 10. These processes by the first control unit 150 are executed by, for example, the display unit 164, which will be described later.

[0036] Next, the configuration of the first indicator 50 will be described. The first indicator 50 includes a tip portion 51 , a shaft portion 52 , a receiving portion 53 , a tip switch 54 , a light emitting portion 55 , a power supply portion 57 , and a second control portion 58 .

[0037] The receiving unit 53 includes a light receiving element that receives near-infrared light, and receives the signal light 170 transmitted from the projector 100. The receiving unit 53 outputs, to the second control unit 58, a control signal indicating the timing at which the signal light 170 is received.

[0038] The tip switch 54 is a switch that turns on when the tip 51 comes into contact with the projection surface 10 and is pressed down, and turns off when the contact between the tip 51 and the projection surface 10 is released.

[0039] The light-emitting unit 55 includes an LED that emits near-infrared light, and the light emission is controlled by the second control unit 58, and outputs the first light 190 that is near-infrared light.

[0040] The power supply unit 57 includes a battery such as a primary battery, a secondary battery, or a photovoltaic cell, and supplies power to each part of the first indicator 50. The first indicator 50 may include a power switch that turns on and off the supply of power from the power supply unit 57.

[0041] The second control unit 58 includes a processor such as a CPU, a storage device such as a memory, and various peripheral circuits. In other words, the second control unit 58 functions as a computer. The second control unit 58 controls each part of the first indicator 50 by the processor executing a program stored in the storage device. The second control unit 58 may also be configured to include multiple processors.

[0042] The second control unit 58 determines the light emission timing, which is the timing at which the light emitting unit 55 emits light, based on the control signal input from the receiving unit 53. The second control unit 58 causes the light emitting unit 55 to emit light at the determined light emission timing, and outputs the first light 190.

[0043] [3. Configuration of first control unit 150] Next, the configuration of the first control unit 150 will be further explained. The first control unit 150 includes, as functional units, an area projection unit 161, a detection unit 162, a determination unit 163, and a display unit 164. Specifically, the processor 160A of the first control unit 150 executes a control program stored in the memory 160B, thereby functioning as the area projection unit 161, the detection unit 162, the determination unit 163, and the display unit 164. In the following description, the indicator is the first indicator 50. The indicator may be the second indicator .

[0044] The area projection unit 161 projects the area image 21 onto the projection surface 10 at a first luminance B1 that is equal to or less than a specific ratio of the maximum luminance that the projector 100 can project onto the projection surface 10. The area image 21 is an image indicating the drawing area 20 where the projector 100 accepts drawing by the first pointer 50, and is an achromatic image. The first brightness B1 may be a brightness that is a specific percentage lower than the maximum brightness, for example, 50% or less of the maximum brightness. The first brightness B1 may also be, for example, 30% or less of the maximum brightness. In this embodiment, the first brightness B1 is, for example, 10% of the maximum brightness. The region image 21 will be further described with reference to FIG.

[0045] The detection unit 162 detects a position PS of the projection surface 10 pointed to by the first indicator 50 when projecting the area image 21. Specifically, the detection unit 162 detects the first light 190 captured in the captured image and the reflected light of the second light 180 reflected by the first indicator 50. The detection unit 162 analyzes the captured image generated by the imaging unit 135 to detect the position PS of the first indicator 50 on the projection surface 10. The detection unit 162 corresponds to a part of a “detection device.” In other words, in this embodiment, the “detection device” includes the imaging unit 135 and the detection unit 162.

[0046] The determination unit 163 determines whether or not the position PS of the first indicator 50 on the projection surface 10 is included in the rendering area 20. Specifically, when the coordinates (X, Y) in the camera coordinate system of the position PS pointed to by the first indicator 50 detected by the detection unit 162 are included in the range of coordinates indicating the projection surface 10 in the camera coordinate system, the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20. The range of coordinates indicating the projection surface 10 in the camera coordinate system is, for example, from (0, 0) to (1919, 1079). In other words, when the X coordinate of the position PS is within the range of 0 to 1919 and the Y coordinate of the position PS is within the range of 0 to 1079, the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20. The camera coordinates indicate, for example, the positions of pixels constituting the imaging element of the imaging unit 135. The pixels constituting the imaging element of the imaging unit 135 are arranged in a grid pattern of 1920 pixels in the X-axis direction and 1080 pixels in the Y-axis direction. The number of pixels constituting the imaging element of the imaging unit 135 is (1920×1080). Camera coordinates are further explained with reference to FIG.

[0047] In addition, when the judgment unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20, it determines whether a specific area AR of a predetermined shape that includes the position PS overlaps with the contour 210 of the drawing area 20. The predetermined shape is, for example, a circle. The radius of the specific area AR is, for example, 50 pixels. The specific area AR is a circle having a radius of 50 pixels and centered on the position PS. The determination unit 163 determines that the specific area AR overlaps with the contour 210 of the drawing area 20 when the shortest distance between the position PS and the contour 210 of the drawing area 20 is 50 pixels or less. In other words, it determines that the specific area AR overlaps with the contour 210 of the drawing area 20 when a part of the contour 210 exists within a radius of 50 pixels from the position PS.

[0048] When the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 uses the projector 100 to display an area including at least a part of the contour 210 of the drawing area 20 at a luminance higher than the first luminance B1.

[0049] In the first embodiment described with reference to Figures 5 to 7, when the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 displays the portion 211 of the contour 210 that overlaps with the specific area AR, for example, at a third luminance B3 that is higher than the first luminance B1. Furthermore, for example, when the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 may display the portion 211 of the contour 210 that overlaps with the specific area AR in a chromatic color. The chromatic color is, for example, red.

[0050] In the first embodiment, when the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 displays, for example, a portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 higher than the first luminance B1, but this is not limited to the above case. When the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 may, for example, display the entire contour 210 at a second luminance B2 higher than the first luminance B1, and display the area image 21 at the first luminance B1 in the area inside the contour 210. The second luminance B2 is, for example, 30% of the maximum luminance that the projector 100 can project onto the projection surface 10. In this case, since the entire contour 210 is displayed at the second luminance B2 higher than the first luminance B1, the user can confirm the overall position of the contour 210. Therefore, user convenience can be improved.

[0051] 8 and 9, when the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 displays the entire drawing area 20 at, for example, a fourth luminance B4 higher than the first luminance B1. That is, when the position PS pointed to by the first indicator 50 is not included in the drawing area 20, the drawing area 20 is displayed at the first luminance B1, and when the position PS is included in the drawing area 20, the drawing area 20 is displayed at a fourth luminance B4 higher than the first luminance B1.

[0052] [4. First embodiment] Next, a first embodiment will be described with reference to FIGS. FIG. 4 is a diagram showing an example of the drawing area 20 and the specific area AR in the first embodiment. 4, the drawing area 20 is disposed on the projection surface 10. The drawing area 20 is an area of ​​the projection surface 10 onto which the image light is projected by the projector 100. The projection surface 10 is, for example, a whiteboard or the surface of a wall. The drawing area 20 is disposed approximately in the center of the projection surface 10.

[0053] The drawing area 20 is formed in a rectangular shape. The long side of the drawing area 20 is parallel to the X-axis direction, and the short side of the drawing area 20 is parallel to the Y-axis direction. The origin of the (X, Y) coordinates indicating the position PS pointed to by the first pointer 50 is, for example, the upper left end of the drawing area 20, that is, the position at the negative end of the X axis and the negative end of the Y axis shown in Fig. 4. The coordinates of the lower right end of the drawing area 20 are (1919, 1079). That is, the (X, Y) coordinate range of the drawing area 20 is 0 to 1919 for the X coordinate and 0 to 1079 for the Y coordinate. The contour 210 is the contour of the drawing area 20 .

[0054] The specific area AR is a circular area with a radius R centered on the position PS pointed to by the first indicator 50. The radius R is, for example, 50 pixels.

[0055] The area projection section 161 projects the area image 21 onto the projection surface 10 at a first luminance B1. The first luminance B1 is, for example, 10% of the maximum luminance that the projector 100 can project onto the projection surface 10.

[0056] FIG. 5 is a diagram showing an example of a display of a portion of a contour 210 that overlaps with a specific area AR in the first embodiment. 5, the (X, Y) coordinates of the position PS pointed to by the first indicator 50 are (48, 500). That is, the position PS is disposed in the vicinity of the left side of the contour 210 of the drawing area 20.

[0057] In this case, the determination unit 163 determines that the position PS pointed to by the first indicator 50 is included in the drawing area 20. The determination unit 163 also determines that the specific area AR overlaps with the contour 210 of the drawing area 20. Then, the display unit 164 displays a portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 that is higher than the first luminance B1. The portion 211 is the portion of the contour 210 that overlaps with the specific area AR. The third luminance B3 is, for example, 50% of the maximum luminance that the projector 100 can project onto the projection surface 10.

[0058] Moreover, portion 211 is a line segment extending from the position (0,486) to the position (0,514) in (X,Y) coordinates. Display unit 164 displays portion 211 in a chromatic color (for example, red). For the sake of convenience, part 211 is shown in red by being drawn with a dashed line in Fig. 5 and Fig. 6.

[0059] FIG. 6 is a diagram showing an example of a display of a portion of a contour 210 that overlaps with a specific area AR in the first embodiment. 6, the (X, Y) coordinates of the position PS pointed to by the first indicator 50 are (10, 1074). That is, the position PS is disposed near the left side and bottom side of the contour 210 of the drawing area 20.

[0060] In this case, the determination unit 163 determines that the position PS pointed to by the first indicator 50 is included in the drawing area 20. The determination unit 163 also determines that the specific area AR overlaps with the contour 210 of the drawing area 20. Then, the display unit 164 displays a portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 that is higher than the first luminance B1. The portion 211 is the portion where the contour 210 overlaps with the specific area AR. The third luminance B3 is, for example, 50% of the maximum luminance that the projector 100 can project onto the projection surface 10.

[0061] A part of portion 211 is the lower end of the left side of contour 210, and the remainder of portion 211 is the left end of the lower side of contour 210. Furthermore, part of portion 211 is a line segment extending from the (X,Y) coordinate position (0,1026) to the (0,1079) position. The remainder of portion 211 is a line segment extending from the (X,Y) coordinate position (0,1079) to the (60,1079) position. The two line segments are connected at the lower left end of contour 210, i.e., at the (X,Y) coordinate position (0,1079), and are arranged in an L shape. The display unit 164 displays the portion 211 in a chromatic color (for example, red).

[0062] 6 also displays a handwritten image 22. The handwritten image 22 corresponds to the locus of the position PS on the projection surface 10 pointed to by the first pointer 50. The brightness BS of the handwritten image 22 is the brightness set by the user. The brightness BS is, for example, the maximum brightness that the projector 100 can project onto the projection surface 10. The color of the handwritten image 22 is the color set by the user (for example, white).

[0063] As described with reference to FIG. 5 and FIG. 6, when the determination unit 163 determines that the position PS is included in the drawing area 20 and also determines that the specific area AR overlaps with the contour 210, the display unit 164 performs the following process. That is, the display unit 164 displays the portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 higher than the first luminance B1. Thus, the user can recognize the position of the contour 210 that is close to the position PS pointed to by the first indicator 50. This improves user convenience. Note that being close to the position PS pointed to by the first indicator 50 means that the distance from the position PS is equal to or less than the radius R. The radius R is the radius of the circular specific area AR.

[0064] Furthermore, since the display unit 164 displays the portion 211 of the contour 210 overlapping the specific area AR in a chromatic color (e.g., red), the visibility of the portion 211 of the contour 210 overlapping the specific area AR can be improved by appropriately setting the chromatic color. This improves user convenience. It is preferable to set the chromatic color to a vivid color that attracts the user's attention.

[0065] FIG. 7 is a flowchart showing an example of the contour display process of the first control unit 150 in the first embodiment. The "contour display process" refers to the following process executed by the display unit 164 when the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 and also determines that the specific area AR overlaps with the contour 210 of the drawing area 20. That is, as described with reference to Figs. 5 and 6, the display unit 164 displays the portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 that is higher than the first luminance B1.

[0066] First, in step S101, the area projection unit 161 projects the area image 21 onto the projection surface 10 at a first luminance B1. Next, in step S103, the detection unit 162 detects the position PS of the projection surface 10 pointed to by the first pointing object 50 when the regional image 21 is projected. Next, in step S105, the determination unit 163 determines whether the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 or not. If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is not included in the drawing area 20 (step S105; NO), the process proceeds to step S111. If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 (step S105; YES), the process proceeds to step S107. Then, in step S107, the determination unit 163 determines whether the specific area AR including the position PS overlaps with the contour 210 of the drawing area 20 or not.

[0067] If the determination unit 163 determines that the specific area AR does not overlap the contour 210 of the drawing area 20 (step S107; NO), the process proceeds to step S111. If the determination unit 163 determines that the specific area AR overlaps the contour 210 of the drawing area 20 (step S107; YES), the process proceeds to step S109. Then, in step S109, the display unit 164 uses the projector 100 to display the portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 that is higher than the first luminance B1. Next, in step S111, the first control unit 150 accepts an operation from the user, and determines whether or not to end the contour display process in accordance with the accepted operation. When the first control unit 150 determines not to end the contour display process (step S111; NO), the process returns to step S103. For example, the first control unit 150 determines not to end the contour display process if an operation instructing the end of the process is not input. When the first control unit 150 determines that the contour display process is to end (step S111; YES), the process is then ended. For example, the first control unit 150 determines that the contour display process is to end if an operation instructing the end of the process is input.

[0068] As described with reference to FIG. 7, when the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 and the specific area AR overlaps with the contour 210, the display unit 164 performs the following process. That is, the display unit 164 displays the portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 higher than the first luminance B1. Thus, the user can recognize the position of the contour 210 that is close to the position PS indicated by the first indicator 50. This improves user convenience.

[0069] [5. Second embodiment] Next, a second embodiment will be described with reference to FIGS. FIG. 8 is a diagram showing an example of the luminance change process of the drawing area 20 in the second embodiment. The "brightness change process" refers to a process of changing the brightness of the drawing area 20 depending on whether or not the position PS of the projection surface 10 pointed to by the first indicator 50 is included in the drawing area 20. For example, when the position PS is not included in the drawing area 20, the display unit 164 projects the region image 21 onto the projection surface 10 at a first brightness B1. When the position PS is included in the drawing area 20, the display unit 164 projects the region image 21 onto the projection surface 10 at a fourth brightness B4 that is higher than the first brightness B1.

[0070] 8 shows an example of the drawing area 20 in a case where the position PS of the projection surface 10 pointed to by the first indicator 50 is not included in the drawing area 20. In the diagram shown in the upper part of FIG. 8, the position PS of the projection surface 10 pointed to by the first indicator 50 is not included in the drawing area 20. In this case, the display unit 164 projects the regional image 21 onto the projection surface 10 at a first luminance B1. The first luminance B1 is, for example, 10% of the maximum luminance that the projector 100 can project onto the projection surface 10.

[0071] 8 shows an example of the drawing area 20 when the position PS of the projection surface 10 pointed to by the first pointer 50 is included in the drawing area 20. In the diagram shown in the lower part of FIG. 8, the position PS of the projection surface 10 pointed to by the first pointer 50 is included in the drawing area 20. In this case, the display unit 164 projects the regional image 21 onto the projection surface 10 at a fourth luminance B4 that is higher than the first luminance B1. The fourth luminance B4 is, for example, 20% of the maximum luminance that the projector 100 can project onto the projection surface 10.

[0072] FIG. 9 is a flowchart showing an example of the luminance change process of the first control unit 150 in the second embodiment. First, in step S201, the area projection unit 161 projects the area image 21 onto the projection surface 10 at a first luminance B1. Next, in step S203, the detection unit 162 detects the position PS of the projection surface 10 pointed to by the first pointing object 50 when the regional image 21 is projected. Next, in step S205, the determination unit 163 determines whether the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 or not. If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is not included in the drawing area 20 (step S205; NO), the process proceeds to step S209. If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 (step S205; YES), the process proceeds to step S207.

[0073] Then, in step S207, the display unit 164 uses the projector 100 The drawing area 20 is projected onto the projection surface 10 at a fourth luminance B4 that is higher than the first luminance B1. Next, in step S209, the first control unit 150 receives an operation from the user. Depending on the operation received, Brightness change It is determined whether or not to end the process. Brightness change If the first control unit 150 determines that the process is not to be ended (step S209; In step S203, the process returns to step S203. When the contour display process is completed, the first control unit 150 If it is determined that the number of the packets is not exceeded (step S209; YES), the process is then terminated.

[0074] As described with reference to Figs. 8 and 9, when the position PS of the projection surface 10 pointed to by the first indicator 50 is not included in the drawing area 20, the display unit 164 projects the region image 21 onto the projection surface 10 at a first luminance B1. When the position PS of the projection surface 10 pointed to by the first indicator 50 is included in the drawing area 20, the display unit 164 projects the region image 21 onto the projection surface 10 at a fourth luminance B4 higher than the first luminance B1. Therefore, the user can visually recognize whether or not the position PS of the projection surface 10 pointed to by the first indicator 50 is included in the drawing area 20 based on the luminance of the region image 21. This improves user convenience.

[0075] [6. Effects] As described above, the control method of the projector 100 of this embodiment includes projecting an achromatic area image 21 indicating the drawing area 20 in which the projector 100 accepts drawing by the first indicator 50 onto the projection surface 10 at a first luminance B1 that is a specific percentage or less of the maximum luminance that the projector 100 can project onto the projection surface 10, detecting a position PS on the projection surface 10 indicated by the first indicator 50 while projecting the area image 21, determining whether the position PS is included in the drawing area 20, and, if it is determined that the position PS is included in the drawing area 20, displaying an area including at least a portion of the contour 210 of the drawing area 20 at a luminance higher than the first luminance B1 using the projector 100. In this way, when it is determined that the position PS is included in the drawing area 20, a region including at least a part of the contour 210 of the drawing area 20 is displayed with a luminance higher than the first luminance B1 of the region image 21, so that the user can visually recognize whether or not the position PS is included in the drawing area 20. Therefore, it is possible to improve user convenience.

[0076] In addition, displaying a region including at least a portion of the contour 210 includes displaying the entire contour 210 at a second luminance B2 higher than the first luminance B1, and displaying a region image 21 at the first luminance B1 in the portion inside the contour 210. In this way, when it is determined that the position PS is included in the drawing area 20, the entire contour 210 is displayed at the second luminance B2 higher than the first luminance B1, so that the user can easily visually determine whether or not the position PS is included in the drawing area 20. Furthermore, since the area image 21 at the first luminance B1 is displayed in the inner part of the contour 210, the luminance of the area drawn by the user with the first indicator 50 is maintained at the first luminance B1. Therefore, it is possible to suppress changes in the appearance of characters, figures, and the like drawn by the user in the drawing area 20, such as the handwritten image 22.

[0077] Furthermore, determining whether or not the position PS is included in the drawing area 20 includes determining whether or not a specific area AR of a predetermined shape that includes the position PS overlaps with the contour 210. In order to determine whether a specific area AR of a predetermined shape including the position PS overlaps with the contour 210, by appropriately setting the size of the specific area AR, it is possible to notify the user that the position PS of the projection surface 10 indicated by the first indicator 50 has approached the contour 210.

[0078] Moreover, displaying the area including at least a portion of the contour 210 includes displaying the portion 211 of the contour 210 that overlaps with the specific area AR at a third luminance B3 that is higher than the first luminance B1. In this way, when the specific area AR overlaps with the contour 210, the portion 211 of the contour 210 that overlaps with the specific area AR is displayed at the third luminance B3 that is higher than the first luminance B1, so that the user can visually recognize the position of the contour 210 near the position PS. Also, since the portion 211 of the contour 210 that overlaps with the specific area AR is displayed at the third luminance B3 that is higher than the first luminance B1, it is possible to reduce the change in the appearance of the entire image displayed on the projection surface 10. Therefore, it is possible to suppress the user viewing the image displayed on the projection surface 10 from feeling uncomfortable.

[0079] Also, displaying portion 211 of contour 210 includes displaying portion 211 of contour 210 in a chromatic color. In this way, since the portion 211 of the contour 210 is displayed in a chromatic color, the visibility of the position of the contour 210 can be improved.

[0080] Moreover, displaying an area including at least a part of the contour 210 includes displaying the entire drawing area 20 at a fourth luminance B4 that is higher than the first luminance B1. In this way, since the entire drawing area 20 is displayed at the fourth luminance B4 which is higher than the first luminance B1, the user can easily visually confirm whether the position PS is included in the drawing area 20 or not.

[0081] The projector 100 of this embodiment includes a light source 121, a light modulation device 123 that emits image light by modulating the light from the light source 121, an imaging section 135 that generates a captured image for detecting a position PS on the projection surface 10 indicated by a first indicator 50, and a first control section 150 that controls the light modulation device 123 and the imaging section 135. The first control section 150 controls an achromatic area image 21 that indicates a drawing area 20 that accepts drawing by the first indicator 50 to be projected onto the projection surface 10 at a maximum size of 100 mm. The region image 21 is projected onto the projection surface 10 at a first luminance B1 that is equal to or lower than a specific ratio of the luminance of the projection surface 10, and while projecting the region image 21, the imaging unit 135 is caused to detect a position PS on the projection surface 10 indicated by the first indicator 50 and determine whether or not the position PS is included in the drawing region 20. If it is determined that the position PS is included in the drawing region 20, the light modulation device 123 is caused to display an area including at least a portion of the contour 210 of the drawing region 20 at a luminance higher than the first luminance B1. In this way, when it is determined that the position PS is included in the drawing area 20, a region including at least a part of the contour 210 of the drawing area 20 is displayed with a luminance higher than the first luminance B1 of the region image 21, so that the user can visually recognize whether or not the position PS is included in the drawing area 20. Therefore, it is possible to improve user convenience.

[0082] [7. Transformation] The above-described embodiment is a preferred embodiment of the present invention, however, the present invention is not limited to this embodiment and can be embodied in various modified forms without departing from the spirit of the present invention.

[0083] In the present embodiment, the case has been described where the indicator is mainly the first indicator 50, but the present invention is not limited to this.

[0084] In the first embodiment, the specific area AR is described as being circular, but is not limited thereto. The specific area AR may be, for example, rectangular. The specific area AR may also be polygonal. The specific area AR may also be oval or elliptical. When the specific area AR is a circle centered on the position PS, it is easy to determine whether the specific area AR overlaps with the contour 210. Specifically, for example, when the distance between the position PS and the contour 210 is equal to or less than the radius R of the specific area AR, it can be determined that the specific area AR overlaps with the contour 210. Also, when the distance between the position PS and the contour 210 is greater than the radius R of the specific area AR, it can be determined that the specific area AR does not overlap with the contour 210.

[0085] In the first embodiment, the case where the portion 211 of the contour 210 overlapping with the specific region AR is displayed in red has been described, but the present invention is not limited to this. The portion 211 of the contour 210 overlapping with the specific region AR may be displayed in a chromatic color. The portion 211 of the contour 210 overlapping with the specific region AR may be displayed in, for example, green.

[0086] In this embodiment, a configuration has been described in which the projector 100 includes the irradiation unit 133 and the imaging unit 135, but at least one of the irradiation unit 133 and the imaging unit 135 may be provided outside the projector 100 as a separate device. Also, part of the functions of the first control unit 150 may be mounted on a separate device provided outside the projector 100. When these components are provided outside the projector 100, they may each be an independent device, or a device including two or more of these components may be used. In these cases, the whole including the separate components may be referred to as the projector.

[0087] Moreover, each functional unit shown in FIG. 3 indicates a functional configuration of the first control unit 150, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is also possible to configure the configuration so that one processor executes a program to realize the functions of multiple functional units. Also, in this embodiment, some of the functions realized by software may be realized by hardware, or some of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of each other unit of the projector 100 can also be changed arbitrarily without departing from the spirit of the invention.

[0088] In addition, the processing units in the flowcharts shown in Fig. 7 and Fig. 9 are divided according to the main processing contents in order to facilitate understanding of the processing of the first control unit 150. There is no limitation to the manner of division or names of the processing units shown in the flowcharts shown in Fig. 7 and Fig. 9, and the processing units can be divided into more processing units according to the processing contents, or one processing unit can be divided to include more processes. In addition, the processing order of the above flowcharts is not limited to the example shown in the figures.

[0089] Furthermore, the projection method of the projector 100 can be realized by having the processor 160A included in the projector 100 execute a control program corresponding to the projection method of the projector 100. This control program can also be recorded on a recording medium that is readable by a computer. As the recording medium, a magnetic or optical recording medium or a semiconductor memory device can be used. Specifically, examples of the recording medium include portable or fixed recording media such as a flexible disk, a hard disk drive (HDD), a compact disk read only memory (CD-ROM), a digital versatile disk (DVD), a Blu-ray (registered trademark) disc, a magneto-optical disk, a flash memory, a card-type recording medium, etc. The recording medium may also be a non-volatile storage device such as a RAM, a ROM, or a HDD, which is an internal storage device provided in the projector 100. In addition, a control program corresponding to the projection method of the projector 100 can be stored in a server device or the like, and the projection method of the projector 100 can be realized by downloading the control program from the server device to the projector 100. [Explanation of symbols]

[0090] 1...projection system, 10...projection surface, 20...drawing area, 21...area image, 22...handwritten image, 50...first indicator (indicator), 70...second indicator (indicator), 100...projector, 110...image generation section, 115...image storage section, 120...projection section, 121...light source, 123...light modulation device, 125...optical unit, 131...transmission section, 133...irradiation section, 135...imaging section ( a first brightness, a second brightness, a third brightness, a fourth brightness, a fourth brightness, a fifth brightness, a sixth brightness, a sixth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a sixth brightness, a seventh brightness, a fifth brightness, a seventh brightness, a fifth brightness, a fifth brightness, a seventh brightness, a fifth brightness, a fifth brightness, a fifth brightness, a fifth brightness, a sixth brightness, a seventh ...

Claims

1. A neutral area image showing the drawing area where the projector accepts drawing by the pointer. A first luminance that is equal to or less than a specific ratio of the maximum luminance that the projector can project onto the projection surface. , projecting the light onto the projection surface; When the area image is projected, a position on the projection surface pointed to by the pointer is detected. And, determining whether the location is included in the drawing area; When it is determined that the position is included in the drawing area, the projector and displaying an area including at least a portion of the outline of the drawing area at a luminance higher than one luminance. And, A method for controlling a projector.

2. Displaying an area including at least a portion of the contour includes: The entire contour is displayed at a second luminance higher than the first luminance, and an inner portion of the contour is displayed at a second luminance higher than the first luminance. displaying the region image at the first luminance; The method for controlling a projector according to claim 1 .

3. The determining step comprises: determining whether a specific area of ​​a predetermined shape including the position overlaps with the contour. 、 The method for controlling a projector according to claim 1 .

4. Displaying an area including at least a portion of the contour includes: A portion of the contour that overlaps with the specific region is displayed at a third luminance that is higher than the first luminance. Including, The method for controlling a projector according to claim 3 .

5. Displaying the portion of the contour may include displaying a portion of the contour that overlaps with the region of the predetermined shape in a chromatic color. The method for controlling a projector according to claim 4 .

6. Displaying an area including at least a portion of the contour includes: displaying the entire drawing area at a fourth luminance higher than the first luminance; The method for controlling a projector according to claim 1 , 3 , 4 , or 5 .

7. A light source; A control unit, The control unit is A colorless area image showing a drawing area that accepts drawing by a pointer is generated using the light source. and projecting the light onto the projection surface at a first luminance that is equal to or less than a specific ratio of a maximum luminance that can be projected onto the projection surface. and When the area image is projected, a position on the projection surface pointed to by the pointer is identified. To do, determining whether the location is included in the drawing area; When it is determined that the position is included in the drawing area, the first light is generated by using the light source. and displaying an area including at least a portion of the outline of the drawing area at a luminance of more than 100 dpi. To control and A projector that does this.

Images