Control method of a projector and projector

Abstract

A control method for a projector and a projector are provided to improve the convenience of drawing with an indicator. The control method for the projector (100) includes: projecting an achromatic area image (21) onto a projection surface (10) at a first brightness (B1), wherein the achromatic area image represents a drawing area (20) for which the projector accepts drawing from a first indicator (50), the first brightness being a specific proportion below the maximum brightness at which the projector can project onto the projection surface (10); detecting a position (PS) on the projection surface (10) indicated by the first indicator when the area image (21) is projected; determining whether the position (PS) is contained within the drawing area (20); and if it is determined that the position (PS) is contained within the drawing area (20), displaying an area containing at least a portion of the outline (210) of the drawing area (20) with a brightness higher than the first brightness (B1) of the area image (21).

Description

Technical Field

[0001] This invention relates to a control method for a projector and to a projector. Background Technology

[0002] Techniques for projecting images onto whiteboards or blackboards are known.

[0003] For example, the image information terminal device described in Patent Document 1 displays a reservation list, including the meeting room reservation time, the person making the reservation, and the information related to the content, on the image display unit via the image output unit. Furthermore, when the image display unit is a whiteboard, the image information terminal device displays the digital meeting minutes obtained by capturing the image from the image display unit with reversed brightness; when the image display unit is a blackboard or similar surface, it displays the minutes with a transparent background.

[0004] Furthermore, the projection system described in Patent Document 2 includes: a light emitting device that emits detection light into a detection area at the indicated position of the detection indicator; and a projector that detects the indicated position of the indicator in the detection area. The projector includes: an imaging unit that captures an image of the detection area; and a position detection unit that detects the indicated position of the indicator based on the image data captured by the imaging unit.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2017-97852

[0006] Patent Document 1: Japanese Patent Application Publication No. 2018-160265

[0007] However, for example, when the background is made transparent for display as described in Patent Document 1, the image generated by the imaging unit capturing the detection area as described in Patent Document 2 may not be able to detect the area depicted by the receiving indicator, making it difficult for the user to draw with the indicator. Summary of the Invention

[0008] One aspect of the present invention is a control method for a projector, comprising the steps of: projecting an achromatic region image onto a projection surface at a first brightness, wherein the achromatic region image represents a depicted area drawn by an indicator received by the projector, the first brightness being below a specific proportion of the maximum brightness that the projector can project onto the projection surface; detecting, while the region image is being projected, a position indicated by the indicator on the projection surface; determining whether the position is contained within the depicted area; and if it is determined that the position is contained within the depicted area, the projector displays an area containing at least a portion of the outline of the depicted area at a brightness higher than the first brightness.

[0009] Another aspect of the present invention is a projector comprising: a light source; a light modulation device that emits image light by modulating light from the light source; a detection device that detects a position on a projection surface indicated by an indicator; and a control unit that controls the light modulation device and the detection device, the control unit controlling the light modulation device to project an achromatic area image onto the projection surface at a first brightness, wherein the achromatic area image represents a depicted area drawn by the indicator, the first brightness being a specific proportion below the maximum brightness that can be projected onto the projection surface; while the area image is being projected, causing the detection device to detect the position on the projection surface indicated by the indicator; determining whether the position is contained within the depicted area; and if it is determined that the position is contained within the depicted area, causing the light modulation device to display an area containing at least a portion of the outline of the depicted area at a brightness higher than the first brightness. Attached Figure Description

[0010] Figure 1 This is a three-dimensional diagram showing an example of the structure of a projection system.

[0011] Figure 2 This is a side view showing an example of a projection system.

[0012] Figure 3 This is a diagram illustrating an example of the structure of the projector and the first indicator of this embodiment.

[0013] Figure 4 This is a diagram illustrating an example of the depicted area and specific area in the first embodiment.

[0014] Figure 5 This is a diagram showing an example of a portion of the outline of the first embodiment that overlaps with a specific region.

[0015] Figure 6 This is a diagram showing an example of a portion of the outline of the first embodiment that overlaps with a specific region.

[0016] Figure 7 This is a flowchart illustrating an example of the outline display processing of the first control unit in the first embodiment.

[0017] Figure 8 This is a diagram illustrating an example of brightness variation processing of the depicted area in the second embodiment.

[0018] Figure 9 This is a flowchart illustrating an example of the brightness change processing of the first control unit in the second embodiment.

[0019] Label Explanation

[0020] 1: Projection system; 10: Projection surface; 20: Drawing area; 21: Area image; 22: Handwritten image; 50: First indicator (indicator); 70: Second indicator (indicator); 100: Projector; 110: Image generation unit; 115: Image storage unit; 120: Projection unit; 121: Light source; 123: Light modulation device; 125: Optical unit; 131: Transmitting unit; 133: Illumination unit; 135: Imaging unit (part of the detection device) 140: Light receiving unit; 150: First control unit (control unit); 160A: Processor; 160B: Memory; 161: Area projection unit; 162: Detection unit (part of the detection device); 163: Judgment unit; 164: Display unit; 210: Outline; 211: Part; AR: Specific area; B1: First brightness; B2: Second brightness; B3: Third brightness; B4: Fourth brightness; BS: Brightness; PS: Position; R: Radius. Detailed Implementation

[0021] Hereinafter, this embodiment will be described with reference to the accompanying drawings. Furthermore, this embodiment includes reference to... Figures 5-7 The first embodiment and reference described herein Figure 8 and Figure 9 The second embodiment will be described.

[0022] [1. Structure of Projection System 1]

[0023] Figure 1 This is a perspective view showing an example of the structure of projection system 1.

[0024] The projection system 1 includes a projector 100, a projection surface 10, and a first indicator 50. The projection surface 10 is the surface on which the projector 100 projects images. The first indicator 50 is used by the user to indicate a position PS on the projection surface 10.

[0025] Alternatively, the position PS on the projection surface 10 can also be indicated by a second indicator 70, such as a user's finger.

[0026] exist Figure 1 The diagram shows the mutually perpendicular X, Y, and Z axes. The Z-axis represents the direction parallel to the normal direction of the projection surface 10. The Y-axis represents the direction parallel to the vertical direction. The X-axis represents the direction perpendicular to both the Z and Y axes. Hereinafter, the positive direction of the Z-axis will sometimes be referred to as "forward". The positive direction of the Y-axis will sometimes be referred to as "downward". The positive direction of the X-axis will sometimes be referred to as "right".

[0027] The projector 100 generates image light corresponding to the image data and projects the generated image light onto the projection surface 10. Furthermore, the projector 100 has a so-called "interactive function." The "interactive function" refers to the following function: detecting the position PS on the projection surface 10 indicated by the first indicator 50 or the second indicator 70, displaying an image corresponding to the position PS or trajectory of the first indicator 50 or the second indicator 70 on the projection surface 10 based on the detected position PS, or modifying the image displayed on the projection surface 10.

[0028] The first indicator 50 is a pen-shaped indicator held by a user, having a light-emitting front end 51 and a user-held shaft 52. A light-emitting part 55, such as an LED (Light Emitting Diode), emitting near-infrared light is mounted on the front end 51. The light-emitting part 55 emits light at predetermined intervals when the front end 51 is in contact with the projection surface 10. Furthermore, the light-emitting part 55 also emits light at predetermined intervals when the front end 51 is not in contact with the projection surface 10.

[0029] exist Figure 1 The diagram shows one first indicator 50, but the number of first indicators 50 that can be used at the same time is not limited to one, and multiple first indicators 50 can also be used at the same time.

[0030] The first indicator 50 corresponds to one example of an "indicator".

[0031] Regarding the first indicator body 50, refer to... Figure 3 Further explanation is needed.

[0032] In addition, when the user's finger is used as the second indicator 70, the user makes the tip of the finger or other end contact the projection surface 10 to indicate the position PS of the projection surface 10.

[0033] The projector 100 emits a detection light along the projection surface 10. When the front end of the second indicator 70 contacts the projection surface 10, it blocks the detection light. Hereinafter, this detection light is referred to as the second light 180. The second light 180 is reflected by the second indicator 70, and a portion of the reflected light from the second indicator 70 moves towards the projector 100. The projector 100 detects the reflected light of the second light 180 after it has been reflected by the second indicator 70, thereby detecting the position PS indicated by the second indicator 70.

[0034] The second indicator 70 corresponds to one example of an "indicator".

[0035] That is, in this embodiment, the "indicator" includes a first indicator 50 and a second indicator 70.

[0036] Figure 2 This is a side view showing an example of projection system 1.

[0037] In this embodiment, the projector 100 is fixed to a wall, for example, and positioned in front of and above the projection surface 10. The projector 100 projects image light toward the projection surface 10 diagonally below the projector 100. The drawing area 20 is the area on the projection surface 10 where the image light is projected by the projector 100. The projector 100 receives the drawing of the indicator in the drawing area 20. In addition, the projector 100 illuminates a second light 180 used for detecting the first indicator 50 and the second indicator 70 in a direction corresponding to the projection surface 10.

[0038] The direction in which the second light 180 is irradiated is, for example, a direction that allows reflected light from the second indicator 70, which is within a predetermined distance of the projection surface 10, to enter the imaging unit 135. The second light 180 is light used to detect the position PS of the second indicator 70, and in this embodiment, it is infrared light. Because the second light 180 is infrared light, the second indicator 70 can be detected without being affected by image light, which is predominantly visible light, and it will not affect the display of the image light. The second light 180 irradiates an area including at least a portion of the projection surface 10. In this embodiment, the second light 180 is, for example, projected to cover an area that covers the entire projection surface 10.

[0039] Regarding the second beam 180, refer to... Figure 3 Further explanation is needed.

[0040] [2. Structure of the projector 100 and the first indicator 50]

[0041] Figure 3 This is a diagram showing an example of the structure of the projector 100 and the first indicator 50.

[0042] First, the structure of the projector 100 will be described. The projector 100 includes an image generation unit 110, a projection unit 120, a transmission unit 131, an illumination unit 133, an imaging unit 135, a light receiving unit 140, and a first control unit 150.

[0043] The image generation unit 110 is an information processing device that includes processors such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The image generation unit 110 has an image storage unit 115 that stores images projected by the projection unit 120. The image storage unit 115 is a so-called "frame memory" that stores images projected by the projection unit 120 in units of frames. In the following description, the images projected by the projection unit 120 are sometimes referred to as "projected images".

[0044] The image generation unit 110 draws a projected image onto the projection surface 10 in the image storage unit 115 based on the image data. The image generation unit 110 outputs an image signal representing the image drawn in the image storage unit 115 to the light modulation device 123 (described later), causing the light modulation device 123 to output image light corresponding to the image data. The image light generated by the light modulation device 123 is projected onto the projection surface 10 by the projection unit 120.

[0045] In addition, the image generation unit 110 performs image processing on the image depicted in the image storage unit 115. For example, the image generation unit 110 performs geometric correction processing to correct trapezoidal distortion in the depicted area 20, digital zoom processing to enlarge or reduce the size of the image displayed on the projection surface 10, and color correction processing to correct the hue of the image displayed on the projection surface 10.

[0046] The projection unit 120 includes a light source 121, a light modulation device 123, and an optical unit 125.

[0047] The light source 121 can be a xenon lamp, an ultra-high pressure mercury lamp, an LED, a laser light source, or other light sources. In addition, the light source 121 may also have a reflector and an auxiliary reflector to guide the light emitted by the light source to the light modulation device 123.

[0048] The light modulation device 123 includes, for example, a modulation element such as a liquid crystal panel. The light modulation device 123 modulates the light incident from the light source 121 according to the image signal input from the image storage unit 115 to form image light. The image light is typically a color image light containing the three colors of visible light: red (R), green (G), and blue (B).

[0049] In this embodiment, the light modulation apparatus 123 is described as having a modulation element such as a liquid crystal panel, but it is not limited to this. The light modulation apparatus 123 may also be a so-called DLP (Digital Light Processing) method that includes a DMD (Digital Mirror Device).

[0050] The optical unit 125 projects the image light formed by the light modulation device 123 onto the projection surface 10, causing it to form an image on the projection surface 10. The optical unit 125 includes at least one of a lens and a mirror. The optical unit 125 may also include a zoom mechanism for magnifying or reducing the image projected onto the projection surface 10, and a focus adjustment mechanism for adjusting the focus.

[0051] The transmitting unit 131 outputs a signal light 170 to synchronize the light emission timing of the first indicator 50 with the shooting timing of the imaging unit 135. Figure 3The signal light 170 is represented by a double-dotted line. The signal light 170 is, for example, a near-infrared light signal that the receiving unit 53 can receive. When the projector 100 is in the powered-on state, the transmitting unit 131 transmits the signal light 170 at predetermined time intervals.

[0052] Signal light 170, for example, represents a control signal that specifies the timing for the first indicator 50 to send first light 190. First light 190 is near-infrared light with a predetermined emission pattern. Figure 3 In the diagram, the first light 190 is represented by a single-dotted line. The first indicator 50 transmits the first light 190, for example, in time synchronization with the received signal light 170.

[0053] In this way, the projector 100 can synchronize the timing of the first light 190 emitted by the first indicator 50 to cause the imaging unit 135 to perform imaging. The transmitting unit 131 includes, for example, a light source such as an LED and a device for controlling the lighting and extinguishing of the light source. The device for controlling the lighting and extinguishing of the light source can be, for example, an ASIC (Application Specific Integrated Circuit) or a FPGA (Field-Programmable Gate Array).

[0054] The irradiation unit 133 irradiates a second light 180 for detecting the first indicator 50 and the second indicator 70 in a direction including the projection surface 10. Figure 3 In the diagram, the second light 180 is represented by a dashed line. The irradiation unit 133 has an LD (Laser Diode) or LED as the light source for outputting infrared light. Alternatively, the irradiation unit 133 may also include optical components that diffuse the infrared light output from the light source toward the projection surface 10.

[0055] The imaging unit 135 is a camera with an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) or CCD (Charge Coupled Device) that receives near-infrared light output from the light-emitting unit 55 of the first indicator 50. Furthermore, the imaging unit 135 includes an optical system for imaging the image onto the imaging element, an aperture for limiting the amount of light incident on the imaging element, etc.

[0056] The imaging unit 135 captures images of the area including the projection surface 10 to generate an image. The imaging unit 135 receives first light 190 output from the first indicator 50 and captures images. The image generated by the imaging unit 135 is output to the first control unit 150.

[0057] The imaging unit 135 corresponds to a part of the "detection device".

[0058] When the imaging unit 135 is taking a picture, it outputs an interrupt signal to the first control unit 150. When the imaging unit 135 receives a response corresponding to the interrupt signal from the first control unit 150, it outputs the captured image to the first control unit 150.

[0059] The light-receiving unit 140 receives infrared signals transmitted from the remote controller 5. The light-receiving unit 140 generates an operation signal corresponding to the received infrared signal and outputs the generated operation signal to the first control unit 150. The operation signal is a signal corresponding to the switch of the remote controller 5 operated by the user.

[0060] The first control unit 150 is a computer device that includes a memory 160B and a processor 160A. The memory 160B includes, for example, volatile memory such as RAM (Random Access Memory) and non-volatile memory such as ROM (Read Only Memory). The volatile memory constitutes the working area of ​​the processor 160A.

[0061] The non-volatile memory stores the control program and calibration data 166 executed by the processor 160A. The control program includes firmware and application programs 165.

[0062] The first control unit 150 corresponds to an example of a "control unit".

[0063] Calibration data 166 is data that establishes a correspondence between the captured image and the depicted area 20 of the projection surface 10. Specifically, calibration data 166 establishes a correspondence between the coordinates of each pixel in the coordinate system of the captured image and the coordinates of each pixel in the coordinate system of the image storage unit 115. In this embodiment, the coordinates of the captured image are recorded as "camera coordinates," and the coordinates of the image storage unit 115 are recorded as "panel coordinates." By referring to calibration data 166, the corresponding position PS of the depicted area 20 is uniquely determined for a single position on the captured image.

[0064] Application 165 is a program executed by processor 160A. Application 165 includes programs that implement interactive functions.

[0065] The processor 160A may consist of, for example, a CPU, an MPU (Micro Processor Unit), etc. The processor 160A controls various parts of the projector 100 by executing control programs. The processor 160A may also consist of multiple processors.

[0066] The first control unit 150 detects the reflected light from the first indicator 50 after the first light 190 and the second light 180 captured in the image are reflected by the first indicator 50. The first control unit 150 analyzes the captured image generated by the imaging unit 135 to determine the position PS indicated by the first indicator 50 and the second indicator 70. The first control unit 150 generates coordinate information representing the positions of the detected light spot of the first light 190 and the reflected light spot of the second light 180, respectively. This coordinate information is represented by camera coordinates.

[0067] These processes of the first control unit 150 are performed, for example, by the detection unit 162, which will be described later.

[0068] The first control unit 150 converts the coordinate information represented by camera coordinates into coordinate information in panel coordinates. This conversion is performed, for example, based on calibration data 166 generated through prior calibration.

[0069] The first control unit 150 controls each part of the projector 100 to display an image on the projection surface 10. It also generates drawing data representing images, graphics, text, symbols, etc., corresponding to the trajectory of the position PS on the projection surface 10 indicated by the first indicator 50 and the second indicator 70. The first control unit 150 outputs the generated drawing data to the image generation unit 110. The first control unit 150 controls the image generation unit 110 to expand the coordinates of the image data on the image storage unit 115 based on the transformed coordinate information. Thus, drawing data is superimposed on the image data and displayed on the projection surface 10.

[0070] These processes of the first control unit 150 are performed, for example, by the display unit 164, which will be described later.

[0071] Next, the structure of the first indicator body 50 will be described.

[0072] The first indicator 50 has a front end 51, a shaft 52, a receiving part 53, a front switch 54, a light-emitting part 55, a power supply part 57, and a second control part 58.

[0073] The receiving unit 53 includes a light-receiving element for receiving near-infrared light, and receives signal light 170 transmitted from the projector 100. The receiving unit 53 outputs a timing control signal, indicating that the signal light 170 has been received, to the second control unit 58.

[0074] The front-end switch 54 is a switch that is turned on when the front end 51 is pressed down due to contact with the projection surface 10, and turned off when the contact between the front end 51 and the projection surface 10 is released.

[0075] The light-emitting unit 55 includes an LED that emits near-infrared light, and the light emission is controlled by the second control unit 58 to output a first light 190 as near-infrared light.

[0076] The power supply unit 57 includes batteries such as primary batteries, secondary batteries, and photovoltaic cells, which provide power to various parts of the first indicator 50. The first indicator 50 may also include a power switch to turn the power supply from the power supply unit 57 on or off.

[0077] The second control unit 58 includes a processor such as a CPU, a storage device such as a memory, and various peripheral circuits. In other words, the second control unit 58 functions as a computer. The second control unit 58 controls various parts of the first instruction unit 50 by executing programs stored in the storage device through the processor. Alternatively, the second control unit 58 may also have a structure with multiple processors.

[0078] The second control unit 58 determines the timing for emitting light from the light-emitting unit 55, i.e., the light emission timing, based on the control signal input from the receiving unit 53. The second control unit 58 causes the light-emitting unit 55 to emit light at the determined light emission timing, and outputs the first light 190.

[0079] [3. Structure of the first control unit 150]

[0080] Next, the structure of the first control unit 150 will be further explained.

[0081] The first control unit 150 includes a region projection unit 161, a detection unit 162, a determination unit 163, and a display unit 164 as functional units. Specifically, the processor 160A of the first control unit 150 executes a control program stored in the memory 160B, thereby performing the functions of the region projection unit 161, the detection unit 162, the determination unit 163, and the display unit 164.

[0082] Furthermore, the following description will focus on the case where the indicator is the first indicator 50. The indicator may also be the second indicator 70.

[0083] The area projection unit 161 projects the area image 21 onto the projection surface 10 at a first brightness B1, which is a specific proportion below the maximum brightness that the projector 100 can project onto the projection surface 10. The area image 21 is an image representing the depicted area 20 that the projector 100 receives from the depiction of the first indicator 50, and is an achromatic image.

[0084] The first brightness B1 can be any brightness that is a certain percentage lower than the maximum brightness, for example, 50% or less of the maximum brightness. Alternatively, the first brightness B1 can also be 30% or less of the maximum brightness. In this embodiment, the first brightness B1 is, for example, 10% of the maximum brightness.

[0085] Regarding region image 21, refer to... Figure 4 Further explanation is needed.

[0086] When the region image 21 is projected, the detection unit 162 detects the position PS on the projection surface 10 indicated by the first indicator 50. Specifically, the detection unit 162 detects the reflected light from the first indicator 50 after the first light 190 and the second light 180 captured in the image are reflected by the first indicator 50. The detection unit 162 analyzes the captured image generated by the imaging unit 135 to detect the position PS of the first indicator 50 on the projection surface 10.

[0087] The detection unit 162 corresponds to a part of the "detection device". In other words, in this embodiment, the "detection device" includes the imaging unit 135 and the detection unit 162.

[0088] The determination unit 163 determines whether the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20.

[0089] Specifically, if the coordinates (X, Y) of the position PS indicated by the first indicator 50 detected by the detection unit 162 in camera coordinates are included in the range of coordinates representing the projection surface 10 in camera coordinates, the determination unit 163 determines that the position PS of the first indicator 50 in the projection surface 10 is included in the drawing area 20. The range of coordinates representing the projection surface 10 in camera coordinates is, for example, (0, 0) to (1919, 1079). That is, if the X coordinate of the position PS is in the range of 0 to 1919 and the Y coordinate of the position PS is in the range of 0 to 1079, the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20.

[0090] Camera coordinates, for example, represent the positions of pixels of the imaging element constituting the imaging unit 135. The pixels of the imaging element constituting the imaging unit 135 are arranged in a grid pattern, with 1920 pixels arranged in the X-axis direction and 1080 pixels arranged in the Y-axis direction. The total number of pixels of the imaging element constituting the imaging unit 135 is (1920 × 1080).

[0091] Regarding camera coordinates, refer to... Figure 4 Further explanation is needed.

[0092] In addition, if the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20, it determines whether a specific area AR of a predetermined shape containing the position PS overlaps with the outline 210 of the drawing area 20.

[0093] The specified shape is, for example, a circle. Additionally, the radius of the specific region AR is, for example, 50 pixels. The specific region AR is a circle centered at position PS with a radius of 50 pixels.

[0094] If the shortest distance between position PS and the outline 210 of drawing area 20 is 50 pixels or less, the determination unit 163 determines that the specific region AR overlaps with the outline 210 of drawing area 20. In other words, if there is a part of outline 210 within a radius of 50 pixels from position PS, the specific region AR is determined to overlap with the outline 210 of drawing area 20.

[0095] If the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 uses the projector 100 to display the area that includes at least a portion of the outline 210 of the drawing area 20 at a brightness higher than the first brightness B1.

[0096] In reference Figures 5-7 In the first embodiment described, when the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 displays, for example, the portion 211 of the outline 210 that overlaps with the specific area AR with a third brightness B3 that is higher than the first brightness B1.

[0097] Alternatively, if the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 may display the portion 211 of the outline 210 that overlaps with the specific area AR in a colored manner. The colored portion may be, for example, red.

[0098] In the first embodiment, the case in which the display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3 that is higher than the first brightness B1 when the determination unit 163 determines that the position PS is included in the drawing area 20 will be described, but it is not limited to this.

[0099] When the determination unit 163 determines that the position PS is included in the depiction area 20, the display unit 164 may, for example, display the entire outline 210 with a second brightness B2 that is higher than the first brightness B1, and display the area image 21 of the first brightness B1 in the inner area of ​​the outline 210. The second brightness B2 is, for example, 30% of the maximum brightness that the projector 100 can project onto the projection surface 10.

[0100] In this case, the entire outline 210 is displayed with a second brightness B2, which is higher than the first brightness B1, so the user can confirm the position of the entire outline 210. Therefore, user convenience can be improved.

[0101] In reference Figure 8 as well as Figure 9In the second embodiment described later, when the determination unit 163 determines that the position PS is included in the drawing area 20, the display unit 164 displays the entire drawing area 20 at a fourth brightness B4, which is higher than the first brightness B1. That is, when the position PS indicated by the first indicator 50 is not included in the drawing area 20, the drawing area 20 is displayed at the first brightness B1, and when the position PS is included in the drawing area 20, the drawing area 20 is displayed at a fourth brightness B4, which is higher than the first brightness B1.

[0102] [4. First Implementation Method]

[0103] Next, refer to Figures 4 to 7 The first embodiment will be described below.

[0104] Figure 4 This is a diagram illustrating an example of the depicted area 20 and the specific area AR in the first embodiment.

[0105] like Figure 4 As shown, the depiction area 20 is disposed on the projection surface 10. The depiction area 20 is the area of ​​the projection surface 10 on which the projector 100 projects image light.

[0106] The projection surface 10 is, for example, the surface of a whiteboard or wall. The depiction area 20 is positioned approximately at the center of the projection surface 10.

[0107] The depiction area 20 is formed as a rectangle. The long side of the depiction area 20 is parallel to the X-axis, and the short side of the depiction area 20 is parallel to the Y-axis.

[0108] The origin of the (X, Y) coordinates of the position PS indicated by the first indicator 50 is, for example, the upper left end of the depicted area 20, i.e. Figure 4 The positions of the negative X-axis and the negative Y-axis are shown. The coordinates of the lower right end of the depicted area 20 are (1919, 1079). That is, the range of (X, Y) coordinates of the depicted area 20 is X coordinate from 0 to 1919 and Y coordinate from 0 to 1079.

[0109] Outline 210 is the outline of the region 20.

[0110] The specific region AR is a circular region with a radius R centered at the position PS indicated by the first indicator 50. The radius R is, for example, 50 pixels.

[0111] The area projection unit 161 projects the area image 21 onto the projection surface 10 at a first brightness B1. The first brightness B1 is, for example, 10% of the maximum brightness that the projector 100 can project onto the projection surface 10.

[0112] Figure 5This is a diagram illustrating an example of the display of the portion of outline 210 in the first embodiment that overlaps with a specific region AR.

[0113] exist Figure 5 In the diagram, the (X, Y) coordinates of the position PS indicated by the first indicator 50 are (48, 500). That is, the position PS is located near the left side of the outline 210 of the drawing area 20.

[0114] In this case, the determination unit 163 determines that the position PS indicated by the first indicator 50 is included in the drawing area 20. Furthermore, the determination unit 163 determines that the specific area AR overlaps with the outline 210 of the drawing area 20. Then, the display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3, which is higher than the first brightness B1. The portion 211 is the portion of the outline 210 that overlaps with the specific area AR. The third brightness B3 is, for example, 50% of the maximum brightness that the projector 100 can project onto the projection surface 10.

[0115] Additionally, part 211 is the line segment from the position with (X, Y) coordinates (0, 486) to the position (0, 514).

[0116] Display unit 164 displays section 211 in a colored (e.g., red) manner. Furthermore, in Figure 5 as well as Figure 6 In the text, for convenience, part 211 is marked with a dashed line to indicate that part 211 is red.

[0117] Figure 6 This is a diagram illustrating an example of the display of the portion of outline 210 in the first embodiment that overlaps with a specific region AR.

[0118] exist Figure 6 In the diagram, the (X, Y) coordinates of the position PS indicated by the first indicator 50 are (10, 1074). That is, the position PS is located near the left and lower sides of the outline 210 of the drawing area 20.

[0119] In this case, the determination unit 163 determines that the position PS indicated by the first indicator 50 is included in the drawing area 20. Furthermore, the determination unit 163 determines that the specific area AR overlaps with the outline 210 of the drawing area 20. Then, the display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3, which is higher than the first brightness B1. The portion 211 is the part where the outline 210 overlaps with the specific area AR.

[0120] The third brightness B3 is, for example, 50% of the maximum brightness that the projector 100 can project onto the projection surface 10.

[0121] Part 211 is partly the lower end of the left side of contour 210, and the remainder of part 211 is the left end of the lower side of contour 210. Furthermore, part 211 is a line segment from position (0, 1026) to position (0, 1079) at (X, Y) coordinates. The remainder of part 211 is a line segment from position (0, 1079) to position (60, 1079) at (X, Y) coordinates. The two line segments connect at the lower left end of contour 210, i.e., at position (0, 1079) at (X, Y) coordinates, forming an L-shape.

[0122] Display section 164 displays section 211 in a colored (e.g., red) manner.

[0123] In addition, Figure 6 The handwritten image 22 is displayed. The handwritten image 22 corresponds to the trajectory of the position PS indicated by the first indicator 50 on the projection surface 10. The brightness BS of the handwritten image 22 is a brightness set by the user. The brightness BS is, for example, the maximum brightness that the projector 100 can project onto the projection surface 10. In addition, the color of the handwritten image 22 is a color set by the user (e.g., white).

[0124] For reference Figure 5 as well as Figure 6 As explained, when the determination unit 163 determines that the position PS is contained within the depicted area 20 and that the specific area AR overlaps with the outline 210, the display unit 164 performs the following processing: The display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3, which is higher than the first brightness B1. Therefore, the user can identify the position of the outline 210 that is close to the position PS indicated by the first indicator 50. This improves user convenience. Furthermore, "close to" the position PS indicated by the first indicator 50 means a distance from the position PS that is less than or equal to a radius R. The radius R is the radius of the circular specific area AR.

[0125] Furthermore, the display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR in a colored manner (e.g., red). Therefore, by appropriately setting the colored portion, the visibility of the portion 211 of the outline 210 that overlaps with the specific area AR can be improved. Thus, user convenience can be improved. As for the colored portion, it is preferable to set it to a bright color that attracts the user's attention.

[0126] Figure 7 This is a flowchart illustrating an example of the outline display processing of the first control unit 150 in the first embodiment.

[0127] "Contour display processing" refers to the following processing performed by the display unit 164 when the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20, and the determination unit 163 determines that the specific area AR overlaps with the contour 210 of the drawing area 20. That is, as referred to Figure 5 and Figure 6 As explained, the display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3, which is higher than the first brightness B1.

[0128] First, in step S101, the area projection unit 161 projects the area image 21 onto the projection surface 10 with a first brightness B1.

[0129] Next, in step S103, when the area image 21 is projected, the detection unit 162 detects the position PS on the projection surface 10 indicated by the first indicator 50.

[0130] Next, in step S105, the determination unit 163 determines whether the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20.

[0131] If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is not included in the drawing area 20 (step S105 is "No"), the process proceeds to step S111. If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 (step S105 is "Yes"), the process proceeds to step S107.

[0132] Then, in step S107, the determination unit 163 determines whether the specific region AR containing the position PS overlaps with the outline 210 of the drawing region 20.

[0133] If the determination unit 163 determines that the specific region AR does not overlap with the outline 210 of the drawing region 20 (step S107 is "No"), the process proceeds to step S111. If the determination unit 163 determines that the specific region AR overlaps with the outline 210 of the drawing region 20 (step S107 is "Yes"), the process proceeds to step S109.

[0134] Then, in step S109, the display unit 164 uses the projector 100 to display the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3 that is higher than the first brightness B1.

[0135] Next, in step S111, the first control unit 150 receives an operation from the user and determines whether to end the outline display process based on the received operation.

[0136] If the first control unit 150 determines that the outline display process should not be terminated (step S111 is "No"), the process returns to step S103. For example, if no instruction to end the process is entered, the first control unit 150 determines that the outline display process should not be terminated. If the first control unit 150 determines that the outline display process should be terminated (step S111 is "Yes"), the process then ends. For example, if an instruction to end the process is entered, the first control unit 150 determines that the outline display process should be terminated.

[0137] For reference Figure 7 As explained, when the position PS of the first indicator 50 on the projection surface 10 is included in the depiction area 20 and the specific area AR overlaps with the outline 210, the display unit 164 performs the following processing: The display unit 164 displays the portion 211 of the outline 210 that overlaps with the specific area AR at a third brightness B3, which is higher than the first brightness B1. Therefore, the user can identify the position of the outline 210 near the position PS indicated by the first indicator 50. This improves user convenience.

[0138] [5. Second Implementation]

[0139] Next, refer to Figure 8 as well as Figure 9 The second embodiment will be described below.

[0140] Figure 8 This is a diagram illustrating an example of the brightness change processing of the depicted area 20 in the second embodiment.

[0141] "Brightness change processing" refers to the process of changing the brightness of the depiction area 20 based on whether the position PS on the projection surface 10 indicated by the first indicator 50 is included in the depiction area 20. For example, if the position PS is not included in the depiction area 20, the display unit 164 projects the area image 21 onto the projection surface 10 with a first brightness B1. If the position PS is included in the depiction area 20, the display unit 164 projects the area image 21 onto the projection surface 10 with a fourth brightness B4, which is higher than the first brightness B1.

[0142] Figure 8 The diagram shown in the upper section illustrates an example of a depiction area 20 where the position PS on the projection surface 10 indicated by the first indicator 50 is not included in the depiction area 20. Figure 8 In the figure shown above, the position PS on the projection surface 10 indicated by the first indicator 50 is not included in the depicted area 20.

[0143] In this case, the display unit 164 projects the area image 21 onto the projection surface 10 at a first brightness B1. The first brightness B1 is, for example, 10% of the maximum brightness that the projector 100 can project onto the projection surface 10.

[0144] Figure 8 The lower section of the diagram shows an example of a depiction area 20 where the position PS on the projection surface 10 indicated by the first indicator 50 is included in the depiction area 20. Figure 8 In the figure shown in the lower section, the position PS on the projection surface 10 indicated by the first indicator 50 is included in the depicted area 20.

[0145] In this case, the display unit 164 projects the area image 21 onto the projection surface 10 with a fourth brightness B4, which is higher than the first brightness B1. The fourth brightness B4 is, for example, 20% of the maximum brightness that the projector 100 can project onto the projection surface 10.

[0146] Figure 9 This is a flowchart illustrating an example of the brightness change processing of the first control unit 150 in the second embodiment.

[0147] First, in step S201, the area projection unit 161 projects the area image 21 onto the projection surface 10 with a first brightness B1.

[0148] Next, in step S203, when the area image 21 is projected, the detection unit 162 detects the position PS on the projection surface 10 indicated by the first indicator 50.

[0149] Next, in step S205, the determination unit 163 determines whether the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20.

[0150] If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is not included in the drawing area 20 (step S205 is "No"), the process proceeds to step S209. If the determination unit 163 determines that the position PS of the first indicator 50 on the projection surface 10 is included in the drawing area 20 (step S205 is "Yes"), the process proceeds to step S207.

[0151] Then, in step S207, the display unit 164 uses the projector 100 to project the depicted area 20 onto the projection surface 10 with a fourth brightness B4 that is higher than the first brightness B1.

[0152] Next, in step S209, the first control unit 150 receives an operation from the user and determines whether to end the brightness change process based on the received operation.

[0153] If the first control unit 150 determines that the brightness change process should not be terminated (step S209 is "No"), the process returns to step S203. If the first control unit 150 determines that the brightness change process should be terminated (step S209 is "Yes"), the process then ends.

[0154] For reference Figure 8 and Figure 9 As explained, when the position PS on the projection surface 10 indicated by the first indicator 50 is not included in the depiction area 20, the display unit 164 projects the area image 21 onto the projection surface 10 at a first brightness B1. Conversely, when the position PS on the projection surface 10 indicated by the first indicator 50 is included in the depiction area 20, the area image 21 is projected onto the projection surface 10 at a fourth brightness B4, which is higher than the first brightness B1. Therefore, the user can visually determine whether the position PS on the projection surface 10 indicated by the first indicator 50 is included in the depiction area 20 based on the brightness of the area image 21. This improves user convenience.

[0155] [6. Effects]

[0156] As explained above, the control method of the projector 100 in this embodiment includes the following steps: projecting a colorless area image 21 onto the projection surface 10 at a first brightness B1, wherein the colorless area image 21 represents a depiction area 20 that the projector 100 receives from the depiction of the first indicator 50, and the first brightness B1 is below a specific proportion of the maximum brightness that the projector 100 can project onto the projection surface 10; when the area image 21 is projected, detecting a position PS on the projection surface 10 indicated by the first indicator 50; determining whether the position PS is included in the depiction area 20; and if it is determined that the position PS is included in the depiction area 20, displaying an area containing at least a portion of the outline 210 of the depiction area 20 using the projector 100 at a brightness higher than the first brightness B1.

[0157] In this way, when it is determined that the position PS is contained within the depicted area 20, the area containing at least a portion of the outline 210 of the depicted area 20 is displayed with a brightness higher than the first brightness B1 of the area image 21, so that the user can visually determine whether the position PS is contained within the depicted area 20. Therefore, user convenience can be improved.

[0158] Additionally, the step of displaying an area containing at least a portion of the outline 210 includes: displaying the entire outline 210 with a second brightness B2 that is higher than the first brightness B1, and displaying an area image 21 of the first brightness B1 in the portion inside the outline 210.

[0159] Thus, when it is determined that the position PS is included in the drawing area 20, the entire outline 210 is displayed with a second brightness B2, which is higher than the first brightness B1. Therefore, the user can easily visually determine whether the position PS is included in the drawing area 20. Furthermore, an area image 21 with the first brightness B1 is displayed on the inner portion of the outline 210, so the brightness of the area drawn by the user with the first indicator 50 is maintained at the first brightness B1. Therefore, changes in the appearance of text, graphics, etc., drawn by the user in the drawing area 20, such as the handwritten image 22, can be suppressed.

[0160] Additionally, the step of determining whether the position PS is contained within the depicted area 20 includes: determining whether a specific region AR of a defined shape containing the position PS overlaps with the outline 210.

[0161] Since it is determined whether a specific region AR containing the position PS overlaps with the contour 210, by appropriately setting the size of the specific region AR, it is possible to notify the user that the position PS on the projection surface 10 indicated by the first indicator 50 is close to the contour 210.

[0162] Additionally, the step of displaying an area containing at least a portion of the outline 210 includes: displaying a portion 211 of the outline 210 that overlaps with a specific region AR at a third brightness B3 that is higher than the first brightness B1.

[0163] In this way, when a specific area AR overlaps with outline 210, the portion 211 of outline 210 overlapping with the specific area AR is displayed with a third brightness B3, which is higher than the first brightness B1. Therefore, the user can visually see the position of outline 210 near position PS. Furthermore, since the portion 211 of outline 210 overlapping with the specific area AR is displayed with a third brightness B3, which is higher than the first brightness B1, changes in the overall appearance of the image displayed on projection surface 10 can be reduced. Therefore, it is possible to suppress any sense of disharmony for the user viewing the image displayed on projection surface 10.

[0164] Additionally, the step of displaying portion 211 of outline 210 includes displaying portion 211 of outline 210 in a colored manner.

[0165] In this way, since the portion 211 of the outline 210 is displayed in color, the visual recognizability of the position of the outline 210 can be improved.

[0166] Additionally, the step of displaying an area containing at least a portion of the outline 210 includes displaying the entire depicted area 20 at a fourth brightness B4 that is higher than the first brightness B1.

[0167] In this way, the entire depiction area 20 is displayed with a fourth brightness B4, which is higher than the first brightness B1, so that the user can easily see whether the position PS is included in the depiction area 20.

[0168] The projector 100 of this embodiment includes: a light source 121; a light modulation device 123 that emits image light by modulating the light from the light source 121; an imaging unit 135 that generates an image for detecting the position PS on the projection surface 10 indicated by the first indicator 50; and a first control unit 150 that controls the light modulation device 123 and the imaging unit 135. The first control unit 150 controls the projection of a colorless area image 21 onto the projection surface 10 with a first brightness B1, wherein the colorless area image 21 represents... The first indicator 50 is used to display the depiction area 20, the first brightness B1 being a certain proportion below the maximum brightness that can be projected onto the projection surface 10; when the area image 21 is projected, the imaging unit 135 detects the position PS on the projection surface 10 indicated by the first indicator 50; determines whether the position PS is included in the depiction area 20; and if it is determined that the position PS is included in the depiction area 20, the light modulation device 123 displays an area containing at least a portion of the outline 210 of the depiction area 20 at a brightness higher than the first brightness B1.

[0169] In this way, when it is determined that the position PS is contained within the depicted area 20, the area containing at least a portion of the outline 210 of the depicted area 20 is displayed with a brightness higher than the first brightness B1 of the area image 21, so that the user can visually determine whether the position PS is contained within the depicted area 20. Therefore, user convenience can be improved.

[0170] [7. Deformation Methods]

[0171] The above-described embodiment is a preferred embodiment of the present invention. However, it is not limited to this embodiment, and can be implemented in various modified ways without departing from the spirit of the present invention.

[0172] In this embodiment, the indicator is described as primarily the first indicator 50, but it is not limited thereto. The indicator may also be the second indicator 70.

[0173] In the first embodiment, the case where the specific region AR is circular was described, but it is not limited to this. The specific region AR can also be rectangular, for example. Alternatively, the specific region AR can also be a polygon. Furthermore, the specific region AR can also be an oblong or an ellipse.

[0174] Furthermore, when the specific region AR is a circle centered at position PS, it is easy to determine whether the specific region AR overlaps with the contour 210. Specifically, for example, if the distance between position PS and contour 210 is less than or equal to the radius R of the specific region AR, it can be determined that the specific region AR overlaps with the contour 210. Conversely, if the distance between position PS and contour 210 is greater than the radius R of the specific region AR, it can be determined that the specific region AR does not overlap with the contour 210.

[0175] In the first embodiment, the case where the portion 211 of the outline 210 overlapping with the specific region AR is shown in red is described, but it is not limited to this. The portion 211 of the outline 210 overlapping with the specific region AR can be displayed in color. For example, the portion 211 of the outline 210 overlapping with the specific region AR can also be displayed in green.

[0176] In this embodiment, the structure of the projector 100 having an illumination section 133 and an imaging section 135 has been described. However, at least one of the illumination section 133 and the imaging section 135 may also be provided as a separate device outside the projector 100. Furthermore, part of the function of the first control section 150 may also be mounted on the separate device provided outside the projector 100. When these structures are provided outside the projector 100, they can be separate and independent devices, or they can be devices including two or more of these structures. In these cases, the entire assembly including the separate structures may also be referred to as a projector.

[0177] in addition, Figure 3 The functional units shown illustrate the functional structure of the first control unit 150, and there are no particular restrictions on the specific installation method. That is, it is not necessary to install hardware corresponding to each functional unit; the functions of multiple functional units can be implemented by a single processor executing a program. In addition, in this embodiment, a portion of the functions implemented in software can be implemented in hardware, or a portion of the functions implemented in hardware can be implemented in software. Furthermore, the specific details of the structure of other parts of the projector 100 can be arbitrarily changed without departing from the main idea.

[0178] in addition, Figure 7 as well as Figure 9 The processing units in the flowcharts shown are divided according to the main processing content for easy understanding of the processing of the first control unit 150. (Unaffected by...) Figure 7 and Figure 9 The segmentation methods and naming restrictions of the processing units shown in the respective flowcharts can be based on the processing content, allowing for segmentation into more processing units or into a single processing unit containing more processes. Furthermore, the processing order in the flowcharts is not limited to the examples shown.

[0179] Furthermore, the projection method of the projector 100 can be implemented by having the processor 160A of the projector 100 execute a control program corresponding to the projection method of the projector 100. Alternatively, this control program can be pre-recorded in a computer-readable recording medium. The recording medium can be a magnetic recording medium, an optical recording medium, or a semiconductor memory device.

[0180] Specifically, examples include removable or fixed recording media such as floppy disks, HDDs (Hard Disk Drives), CD-ROMs (CompactDisk Read Only Memory), DVDs (Digital Versatile Discs), Blu-ray discs, optical disks, flash memory, and card-type recording media. Alternatively, the recording media can also be the internal storage devices of the projector 100, such as RAM, ROM, and HDDs—non-volatile storage devices.

[0181] Alternatively, the projection method of the projector 100 can be implemented by pre-storing the control program corresponding to the projection method of the projector 100 in a server device or the like, and then downloading the control program from the server device to the projector 100.

Claims

1. A control method for a projector, wherein, The control method for this projector includes the following steps: An achromatic area image is projected onto a projection surface at a first brightness, wherein the achromatic area image represents a depicted area that the projector can accept the depiction of an indicator, and the first brightness is a specific proportion below the maximum brightness that the projector can project onto the projection surface. When the image of the region is projected, the position on the projection surface indicated by the indicator is detected; Determine whether the location is contained within the depicted area; and If the location is determined to be contained within the depicted area, the projector displays an area containing at least a portion of the outline of the depicted area at a brightness higher than the first brightness.

2. The control method for a projector according to claim 1, wherein, The step of displaying a region containing at least a portion of the outline includes: The entire outline is displayed with a second brightness higher than the first brightness; and The region image with the first brightness is displayed on the portion inside the outline.

3. The control method for a projector according to claim 1, wherein, The steps for making the determination include: Determine whether the region containing the specified shape at the location overlaps with the outline.

4. The control method for a projector according to claim 3, wherein, The step of displaying a region containing at least a portion of the outline includes: The portion of the outline that overlaps with the area of ​​the defined shape is displayed at a third brightness that is higher than the first brightness.

5. The control method for a projector according to claim 4, wherein, The portion of the outline that overlaps with the area of ​​the defined shape is displayed in color.

6. The control method for a projector according to any one of claims 1, 3, 4, and 5, wherein, The step of displaying a region containing at least a portion of the outline includes: The entire depicted area is displayed with a fourth brightness, which is higher than the first brightness.

7. A projector, wherein, The projector includes: light source; The detection device, the position on the projection surface indicated by its detection indicator; and Control Department The control unit performs the following controls: The light source is used to project an achromatic area image onto the projection surface at a first brightness, wherein the achromatic area image represents a depiction area capable of receiving the depiction of the indicator, and the first brightness is a specific proportion below the maximum brightness capable of being projected onto the projection surface; When the image of the area is projected, the detection device is used to detect the position on the projection surface indicated by the indicator; Determine whether the location is contained within the depicted area; and If it is determined that the location is contained within the depicted area, the light source is used to display at least a portion of the outline of the depicted area at a brightness higher than the first brightness.

Images