Method for detecting an indicator body and projection system

Abstract

A detection method of an indicator and a projection system can detect the position of an indicator even in an area where an object other than the indicator is arranged. A first control section (150) of a projector (100) executes a first mode and a second mode, the first mode includes detecting first light (190) emitted from a first indicator (50), thereby detecting the position of the first indicator (50) on a projection surface (10), and a light emitting device emits second light (180), and detects reflected light of the second light (180) reflected by a second indicator (70), thereby detecting the position of the second indicator (70) on the projection surface (10), the second mode includes reducing the light amount of the second light (180) when it is determined that the first indicator (50) is in contact with the projection surface (10), and detecting the first light (190) in a state where the light amount of the second light (180) is reduced, thereby detecting the position of the first indicator on the projection surface (10).

Description

TECHNICAL FIELD

[0001] The present application relates to a pointing body detection method and a projection system. BACKGROUND

[0002] Conventionally, there is known a device that detects a pointing position of a pointing body by detecting reflected light of light emitted from a light emitting device and reflected by the pointing body.

[0003] For example, an image projection system disclosed in Patent Literature 1 forms a light curtain by causing infrared laser light shaped into a sheet from a laser emitter to propagate along a table. When an electronic pen touches a certain position on the table, the laser light is reflected at the position. The image projection system captures the reflected light thereof with a camera, and detects the position of the electronic pen based on the captured data. In Patent Literature 1, an obstacle on the table is detected, and a region on a projection image that will be affected by the obstacle is set to be excluded from a region in which an operation of the electronic pen is effective. Thereby, an influence of the laser light being blocked by the obstacle or the laser light being reflected by the obstacle is suppressed.

[0004] Patent Literature 1: Japanese Patent Application Publication No. 2017-9829

[0005] However, in the region excluded from the region in which the operation of the electronic pen is effective, an operation based on the electronic pen cannot be performed. In a region in which an object other than the pointing body is disposed, it is sometimes required to detect a position of the pointing body. SUMMARY

[0006] One embodiment of the present disclosure is a pointing body detection method including a first mode and a second mode, the first mode including detecting first light emitted from a first pointing body, thereby detecting a position of the first pointing body on an operation surface, a light emitting device emitting second light, and detecting reflected light of the second light reflected by a second pointing body, thereby detecting a position of the second pointing body on the operation surface, and the second mode including reducing an amount of light of the second light in a case where it is determined that the first pointing body is in contact with the operation surface, and detecting the first light in a state where the amount of light of the second light is reduced, thereby detecting the position of the first pointing body on the operation surface.

[0007] One embodiment of the present disclosure is a projection system including: a first pointing body that emits first light; a light emitting device that emits second light; a control section that operates in a first mode and a second mode, the first mode including detecting the first light emitted by the first pointing body, thereby detecting a position of the first pointing body on an operation surface, and detecting reflected light of the second light reflected by a second pointing body, thereby detecting a position of the second pointing body with respect to the operation surface, the second mode including reducing an amount of light of the second light in a case where it is determined that the first pointing body is in contact with the operation surface, and detecting the first light in a state where the amount of light of the second light is reduced, thereby detecting the position of the first pointing body on the operation surface; and an optical device that projects image light to the operation surface based on the position of the first pointing body or the position of the second pointing body. BRIEF DESCRIPTION OF DRAWINGS

[0008] Figure 1 is a perspective view showing a system configuration of a projection system.

[0009] Figure 2 is a side view of a projection system.

[0010] Figure 3 is a configuration view showing a configuration of a projector and a first pointing body.

[0011] Figure 4 is a view showing a light emission mode of a first light emitting section and an irradiation section.

[0012] Figure 5 is a flowchart showing an operation of a first control section.

[0013] Figure 6 is a flowchart showing an operation of a first stage of the first control section.

[0014] Figure 7 is a flowchart showing an operation of a second stage of the first control section.

[0015] Figure 8 is a flowchart showing an operation of a third stage of the first control section.

[0016] Figure 9 is a flowchart showing an operation of a fourth stage of the first control section.

[0017] REFERENCE NUMERALS

[0018] 1: projection system; 5: remote controller; 10: projection surface; 20: projection area; 50, 50A, 50B: first pointing body; 51: tip portion; 52: shaft portion; 53: receiving portion; 54: tip switch; 55: light emitting portion; 57: power supply portion; 58: second control portion; 70: second pointing body; 100: projector; 110: image generation portion; 115: image storage portion; 120: projection portion; 121: light source; 123: light modulation device; 125: optical unit; 131: transmission portion; 133: irradiation portion; 135: photographing portion; 140: light receiving portion; 150: first control portion; 160: storage portion; 161: application program; 163: calibration data; 165: processor; 170: signal light; 180: second light; 190: first light. DETAILED DESCRIPTION

[0019] 1. Structure of projection system 1

[0020] Figure 1 is a perspective view showing the system structure of the projection system 1.

[0021] The projection system 1 has a projector 100, a projection surface 10 on which an image is projected by the projector 100, and a first pointing body 50 for designating the position of the projection surface 10. The position designation of the projection surface 10 can also be made by a second pointing body 70 which is a user's finger or the like. Hereinafter, the normal line of the projection surface 10 is taken as the Z axis, the vertical axis is taken as the Y axis, and the axis perpendicular to the directions of the Z axis and the Y axis is taken as the X axis. The projection surface 10 corresponds to one example of an operation surface.

[0022] The projector 100 generates image light corresponding to image data and projects the generated image light to the projection surface 10. Further, the projector 100 has an interactive function. The interactive function refers to a function of detecting the position of the projection surface 10 designated by the first pointing body 50 and the second pointing body 70, displaying an image corresponding to the position and the trajectory of the first pointing body 50 and the second pointing body 70 in accordance with the detected position, or imposing a change on the displayed image.

[0023] The first pointing body 50 is a pen-type pointing body which is held by a user, and has a tip portion 51 which can emit light, a shaft portion 52 which is held by the user, and the like. A light source such as an LED (Light Emitting Diode) which emits near-infrared light is mounted on the tip portion 51. The first pointing body 50 emits light at a prescribed light emission interval in a state in which the tip portion 51 is in contact with the projection surface 10. In addition, the first pointing body 50 also emits light at a prescribed light emission interval in a state in which the tip portion 51 is not in contact with the projection surface 10. In addition, the first pointing body 50 has a tip switch 54 which detects the contact with the projection surface 10. Figure 1One first pointing body 50 is shown in FIG. 1, but the number of first pointing bodies 50 that can be used at the same time is not limited to one, and a plurality of first pointing bodies 50 can be used at the same time.

[0024] In addition, in a case where a finger of a user is used as the second pointing body 70, the user contacts the tip end such as a fingertip with the projection surface 10 to specify the position of the projection surface 10.

[0025] The projector 100 emits the detection light along the projection surface 10, and the tip end of the second pointing body 70 blocks the detection light when the tip end contacts the projection surface 10. Hereinafter, the detection light is referred to as second light 180. The second light 180 reaches the second pointing body 70 and is reflected, and a part of the reflected light of the second light 180 advances from the second pointing body 70 toward the projector 100. The projector 100 detects the reflected light after the second light 180 is reflected by the second pointing body 70, and thereby detects the position indicated by the second pointing body 70.

[0026] Figure 2 is a side view of the projection system 1.

[0027] The projector 100 of the present embodiment is fixed to a wall surface and disposed in front of and above the projection surface 10, and projects the image light toward the projection surface 10 obliquely downward. The region of the projection surface 10 on which the image light is projected by the projector 100 is referred to as a projection region 20. In addition, the projector 100 irradiates the second light 180 used in the detection of the first pointing body 50 and the second pointing body 70 in a direction corresponding to the projection surface 10. Specifically, it is a direction in which the reflected light reflected by the second pointing body 70 that is within a prescribed distance from the projection surface 10 can be incident on the imaging section 135. The second light 180 is light for detecting the second pointing body 70, and in the present embodiment, infrared light is used. By using infrared light, the second pointing body 70 can be detected without being affected by the image light that is mainly visible light, and in addition, the display based on the image light is not affected. The second light 180 is irradiated to a range including at least a part of the projection surface 10. In the present embodiment, the range is projected to cover the entire projection surface 10.

[0028] 2. Structure of the projector 100 and the first pointing body 50

[0029] Figure 3 is a block diagram showing the structure of the projector 100 and the first pointing body 50. First, the structure of the projector 100 will be described.

[0030] The projector 100 has an image generation section 110, a projection section 120, a transmission section 131, an irradiation section 133, an imaging section 135, a light receiving section 140, and a first control section 150.

[0031] The image generation section 110 is an arithmetic processing device constituted by a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The image generation section 110 has an image storage section 115 that stores a projection image. The image storage section 115 is a so-called frame memory that stores an image projected by the projection section 120 in units of frames.

[0032] The image generation section 110 draws a projection image projected onto the projection surface 10 in the image storage section 115 in accordance with image data. The image generation section 110 outputs an image signal representing an image that has been drawn in the image storage section 115 to the light modulation device 123 described later, and projects image light corresponding to the image data onto the projection surface 10 by the projection section 120. The projection section 120 corresponds to an optical device.

[0033] In addition, the image generation section 110 performs image processing on an image drawn in the image storage section 115. For example, the image generation section 110 performs a geometric correction process that corrects trapezoidal distortion of the projection region 20 and the like, a digital zoom process that enlarges or reduces the size of an image displayed on the projection surface 10, a color correction process that corrects the color tone of an image displayed on the projection surface 10 and the like.

[0034] The projection section 120 has a light source 121, a light modulation device 123, and an optical unit 125.

[0035] The light source 121 has a xenon lamp, an ultrahigh-pressure mercury lamp, an LED, a laser light source, and the like. In addition, the light source 121 can also have a reflector and an auxiliary reflector that guide light emitted from the light source to the light modulation device 123.

[0036] The light modulation device 123 has a modulation element such as a liquid crystal panel, for example. The light modulation device 123 forms image light by modulating light incident from the light source 121 in accordance with an image signal input from the image storage section 115. The image light is typically color image light that includes visible light of three colors of red (R), green (G), and blue (B).

[0037] The optical unit 125 projects image light formed by the light modulation device 123 onto the projection surface 10 so as to be imaged on the projection surface 10. The optical unit 125 includes at least one of a lens and a mirror. The optical unit 125 can also have a zoom mechanism that enlarges or reduces an image projected on the projection surface 10, a focus adjustment mechanism that performs adjustment of focusing, and the like.

[0038] The transmission section 131 outputs a signal, that is, signal light 170, for synchronizing the light emission timing of the first indicator 50 with the photographing timing of the photographing section 135. The signal light 170 is output to the first indicator 50 and the photographing section 135. Figure 3The signal light 170 is indicated by a double-dot chain line. The signal light 170 is a signal of near-infrared light that the first indicating body 50 can receive by the receiving section 53 described later. The transmitting section 131 periodically transmits the signal light 170 in the activation of the projector 100.

[0039] The signal light 170 is, for example, a control signal that specifies a timing at which the first indicating body 50 transmits the first light 190. The first light 190 is near-infrared light having a predetermined emission pattern. The first light 190 is emitted from the first indicating body 50 in response to the signal light 170. Figure 3 The first light 190 is indicated by a single-dot chain line. The first indicating body 50 transmits the first light 190, for example, in synchronization with the timing at which the signal light 170 is received.

[0040] Therefore, the projector 100 can cause the photographing section 135 to perform photographing in accordance with the timing at which the first indicating body 50 emits the first light 190. The transmitting section 131 has, for example, a light source such as an LED and a device that controls the lighting and extinguishing of the light source. The device that performs the control can be constituted by an ASIC (Application Specific Integrated Circuit), an FPGA (field-programmable gate array), or the like.

[0041] The irradiating section 133 irradiates the second light 180 for detecting the first indicating body 50 and the second indicating body 70 toward the direction in which the projection surface 10 is included. Figure 3 The second light 180 is indicated by a dotted line. The irradiating section 133 has an LD (Laser Diode) or an LED as a light source that emits infrared light. In addition, the irradiating section 133 can have an optical member that diffuses the infrared light emitted from the light source toward the projection surface 10. The irradiating section 133 corresponds to an example of a light emitting device.

[0042] The photographing section 135 is a camera that has a photographing element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) that receives the near-infrared light emitted from the light emitting section 55 of the first indicating body 50. Furthermore, the photographing section 135 has an optical system that images on the photographing element, an aperture that limits the light incident to the photographing element, and the like.

[0043] The photographing section 135 photographs the range in which the projection surface 10 is included and generates a photographed image. The photographing section 135 receives the first light 190 emitted from the first indicating body 50 and performs photographing. The photographed image generated by the photographing section 135 is output to the first control section 150.

[0044] The imaging section 135 outputs an interrupt signal to the first control section 150 after imaging. The imaging section 135 outputs the imaged image to the first control section 150 when receiving a response corresponding to the interrupt signal from the first control section 150.

[0045] The light receiving section 140 receives an infrared signal transmitted from the remote controller 5. The light receiving section 140 generates an operation signal corresponding to the received infrared signal, and outputs the generated operation signal to the first control section 150. The operation signal is a signal corresponding to a switch of the remote controller 5 operated by the user.

[0046] The first control section 150 is a computer device having a storage section 160 and a processor 165. The storage section 160 has, for example, a volatile memory such as a RAM (Random Access Memory) and a non-volatile memory such as a ROM (Read Only Memory). The volatile memory constitutes a work area of the processor 165. The non-volatile memory stores a control program executed by the processor 165, calibration data 163. The control program includes firmware and an application program 161.

[0047] The calibration data 163 is data in which the imaged image and the projection area 20 of the projection surface 10 are associated with each other. More specifically, it is data in which the coordinates of each pixel in the coordinate system of the imaged image and the coordinates of each pixel in the coordinate system of the image storage section 115 are associated with each other. The coordinates of the imaged image are referred to as camera coordinates, and the coordinates of the image storage section 115 are referred to as panel coordinates. By referring to the calibration data 163, a corresponding position of the projection area 20 is uniquely determined for one position on the imaged image.

[0048] The application program 161 is a program executed by the processor 165. The application program 161 is a program that realizes an interactive function.

[0049] The processor 165 is constituted by, for example, a CPU, an MPU (Micro Processor Unit). The processor 165 controls each section of the projector 100 by executing the control program. The first control section 150 can also have a structure having a plurality of processors.

[0050] The first control section 150 detects the reflected light of the first light 190 and the second light 180 imaged in the imaged image, which are reflected by the first indicating body 50. The first control section 150 analyzes the imaged image generated by the imaging section 135, and determines the indicating positions of the first indicating body 50 and the second indicating body 70. The first control section 150 generates coordinate information indicating the position of the light spot of the detected first light 190 and the position of the light spot of the reflected light of the second light 180. The coordinate information is expressed by camera coordinates.

[0051] The 1st control section 150 converts the coordinate information represented by the camera coordinates into coordinate information of the panel coordinates. This conversion is performed, for example, on the basis of calibration data 163 generated through calibration performed in advance.

[0052] The 1st control section 150 controls the respective parts of the projector 100 so that the projection surface 10 displays an image. In addition, drawing data representing an image, a figure, a character, a symbol, or the like corresponding to the locus of the position of the projection surface 10 indicated by the 1st pointing body 50 and the 2nd pointing body 70 is generated. The 1st control section 150 outputs the generated drawing data to the image generation section 110. The 1st control section 150 controls the image generation section 110 to cause the image data to be developed into coordinates on the image storage section 115 on the basis of the converted coordinate information. Thereby, the drawing data is superimposed on the image data and displayed on the projection surface 10.

[0053] Next, the structure of the 1st pointing body 50 will be described.

[0054] The 1st pointing body 50 has a tip section 51, a shaft section 52, a receiving section 53, a tip switch 54, a light emitting section 55, a power supply section 57, and a 2nd control section 58.

[0055] The receiving section 53 includes a light receiving element or the like that receives infrared light, and receives the signal light 170 transmitted by the projector 100. The receiving section 53 outputs a control signal or the like representing the timing at which the signal light 170 is received to the 2nd control section 58.

[0056] The tip switch 54 is a switch that is turned on when the tip section 51 is pressed by the tip section 51 coming into contact with the projection surface 10, and turned off when the contact of the tip section 51 with the projection surface 10 is released.

[0057] The light emitting section 55 includes an LED that emits near-infrared light, and emits the 1st light 190 as near-infrared light under the control of the 2nd control section 58.

[0058] The power supply section 57 has a battery such as a primary cell, a secondary cell, a photovoltaic cell, or the like, and supplies electric power to the respective parts of the 1st pointing body 50. The 1st pointing body 50 can also have a power supply switch that turns on or off the supply of power from the power supply section 57.

[0059] The 2nd control section 58 has a processor such as a CPU, a storage device such as a memory, and various peripheral circuits. That is, the 2nd control section 58 has the function of a computer. The 2nd control section 58 controls the respective parts of the 1st pointing body 50 by the processor executing a program stored in the storage device. In addition, the 2nd control section 58 can also have a structure having a plurality of processors.

[0060] The second control section 58 decides the light emission timing of the light emission section 55 based on the control signal input from the reception section 53. The second control section 58 causes the light emission section 55 to emit light at the decided light emission timing, and outputs the first light 190.

[0061] 3. Light emission pattern of the first indicating body 50, the transmission section 131, and the irradiation section 133

[0062] Figure 4 The light emission pattern of the first light 190 when not drawn, the light emission pattern of the first light 190 when drawn, the light emission pattern of the second light 180, and the light emission pattern of the signal light 170 are shown. Not drawn means a state in which the tip of the first indicating body 50 is not in contact with the projection surface 10, and thus the tip switch 54 is off. In addition, drawn means a state in which the tip of the first indicating body 50 is in contact with the projection surface 10, and thus the tip switch 54 is on.

[0063] The first indicating body 50 and the projector 100 repeatedly perform an operation in which the four stages of the first stage, the second stage, the third stage, and the fourth stage are one cycle. Hereinafter, one cycle composed of the four stages of the first stage, the second stage, the third stage, and the fourth stage is referred to as a stage. Figure 4 Six stages of the first stage to the sixth stage are shown. "1A" and "1B" in each stage indicate the first stage. In addition, "2" in each stage indicates the second stage. In addition, "3" in each stage indicates the third stage. In addition, "4" in each stage indicates the fourth stage.

[0064] Figure 4 The value "1" shown indicates that the corresponding first indicating body 50, transmission section 131, or irradiation section 133 is in the lighted state. In addition, Figure 4 The value "0" shown indicates that the corresponding first indicating body 50, transmission section 131, or irradiation section 133 is in the unlighted state.

[0065] The first stage is a stage for synchronization, and corresponds to the first period. In the first stage, the transmission section 131 of the projector 100 is lighted. By the transmission section 131 being lighted, the signal light 170 as a synchronization signal is output. The length of time of each of the first stage to the fourth stage is set in advance, and the first indicating body 50 determines the start timing of each of the first stage to the fourth stage by receiving the signal light 170.

[0066] In addition, the first stage is composed of two stages of the first stage A and the first stage B. In the first stage, the first stage A and the first stage B are alternately repeated. Figure 4 The "1A" shown corresponds to the first stage A, Figure 4The "1B" shown corresponds to the first stage B. In addition, the first indicator 50 in the first stage transmits the first light 190 at a timing that does not overlap with the timing at which the signal light 170 is output from the transmission section 131.

[0067] In addition, in the first stage B, a signal that reverses the light emission state of the first indicator 50 in the third stage of the previous period is transmitted.

[0068] For example, the light-on state of the first indicator 50 in the third stage of the third period is on both in the un-drawing time and the drawing time, and is therefore reversed in the first stage B of the fourth period to become a non-light-on state both in the un-drawing time and the drawing time. In addition, the light-on state of the first indicator 50 in the third stage of the fifth period is a non-light-on state in the un-drawing time, but is a light-on state in the drawing time. This is reversed in the first stage B of the following sixth period, and the first indicator 50 becomes a light-on state in the un-drawing time, and the first indicator 50 becomes a non-light-on state in the drawing time.

[0069] The second stage and the fourth stage are stages of position detection. The second stage and the fourth stage correspond to the second period.

[0070] In the second stage and the fourth stage, the first indicator 50 and the irradiation section 133 are on. The first indicator 50 is on regardless of whether the end switch 54 is on or off. The first light 190 is output by turning on the first indicator 50, and the second light 180 is output by turning on the irradiation section 133.

[0071] The projector 100 causes the imaging section 135 to perform imaging in accordance with the light emission timing of the first indicator 50 in the second stage and the fourth stage, and performs imaging of the projection surface 10. An image of the light spot including the first light 190 when the first indicator 50 is on, and an image of the light spot of the reflected light including the second light 180 when drawing is performed by the second indicator 70 are acquired. Thus, the position of the first indicator 50 and the position of the second indicator 70 are detected by the projector 100.

[0072] The third stage is a stage in which only the first indicator 50 is on, and corresponds to the first period. In addition, the third stage is a stage of identifying the individual of the indicator. Furthermore, the third stage is a notification stage of notifying the projector 100 of whether the end switch 54 has been turned on. In the third stage, the first indicator 50 emits light in a light emission pattern that is set in advance. The first indicator 50 switches the light emission pattern in the third stage in accordance with whether the end switch 54 is on or off.

[0073] For example, assume that "001" is set as the light emission pattern in the 3rd stage in the 1st indicator 50. This light emission pattern "001" is an indicator ID that identifies the 1st indicator 50, and is a light emission pattern inherent to each 1st indicator 50. The 1st indicator 50 repeatedly the light emission pattern of "001" in the 3rd stage in the consecutive 3 periods when not depicted. In Figure 4 In the example shown, the 1st indicator 50 outputs the 1st light 190 in the light emission pattern of "001" in the consecutive 3 periods of the 1st period, the 2nd period, and the 3rd period. The projector 100 reads the repeated pattern from the presence or absence of light emission in the 3rd stage of the consecutive periods, thereby identifying the individual of the 1st indicator 50. Note that the indicator ID can also be expressed without 3 periods. For example, in the case of using 2 1st indicators 50, the 1st indicator 50A and the 1st indicator 50B, different indicator IDs can be used for the number of periods, such as "001" for the 1st indicator 50A and "0001" for the 1st indicator 50B.

[0074] In addition, the 1st indicator 50 repeatedly a light emission pattern in which the light emission pattern indicating the indicator ID is inverted in the 3rd stage when the tip switch 54 is on, i.e., when depicted. Therefore, in the case of the indicator ID being "001", the 1st indicator 50 emits light in the light emission pattern of "110" in the 3rd stage in the consecutive 3 periods. Figure 4 In the example shown, the 1st indicator 50 outputs the 1st light 190 in the light emission pattern of "110" in the consecutive 3 periods of the 1st period, the 2nd period, and the 3rd period.

[0075] The projector 100 causes the imaging unit 135 to image the projection surface 10 in synchronization with the light emission timing of the 1st indicator 50 in the 3rd stage. When the 1st indicator 50 is lit, an image in which a light spot of the 1st light 190 is included is acquired. Furthermore, the projector 100 detects a contact state in which the tip portion 51 of the 1st indicator 50 is in contact with the screen SS based on the light emission pattern when the tip switch 54 is on, and detects a hovering state in which the tip portion 51 of the 1st indicator 50 is not in contact with the screen SS based on the light emission pattern when the tip switch 54 is off.

[0076] 4. Action of the 1st control unit 150

[0077] The action of the 1st control unit 150 will be further described. When the 1st control unit 150 acquires coordinate information in the 2nd stage and the 4th stage that are stages of position detection, it temporarily stores the acquired coordinate information in the storage unit 160 in order to pass the coordinate information to the application 161.

[0078] However, in the 2nd stage and the 4th stage, there is a case where the 1st control section 150 cannot acquire the coordinate information of the light spot of the 1st pointing body 50. For example, assume that an object such as a ruler is in contact with the projection surface 10 or the like in order to draw a straight line on the projection surface 10 by the 1st pointing body 50, or an object is disposed at a position where the 2nd light 180 irradiated by the irradiation section 133 is reflected.

[0079] As described above, in the 2nd stage and the 4th stage which are stages of position detection, the 1st pointing body 50 outputs the 1st light 190, and the irradiation section 133 outputs the 2nd light 180. Therefore, when an object such as a ruler is in contact with the projection surface 10 and a straight line is drawn by the 1st pointing body 50 or the like, or when drawing based on the 1st pointing body 50 is performed in the vicinity of the object, in the 2nd stage and the 4th stage, the reflected light of the 2nd light 180 output by the irradiation section 133 is reflected by the object, and the reflected reflected light is detected as a light spot by the 1st control section 150. Therefore, there is a case where the 1st light 190 output by the 1st pointing body 50 is buried by the reflected light of the 2nd light 180. In such a case, it is difficult to determine the 1st light 190 from the reflected light of the 2nd light 180 to determine the pointing position of the 1st pointing body 50.

[0080] Therefore, the 1st control section 150 temporarily stores the coordinate information detected in the next 3rd stage or 1st stage in the storage section 160 in a case where the coordinate information of the 1st light 190 cannot be determined from the coordinate information of the 2nd stage or the 4th stage. The 1st control section 150 transmits the coordinate information detected in the 3rd stage or the 1st stage to the application 161.

[0081] In the 1st stage and the 3rd stage, the irradiation section 133 does not output the 2nd light 180. In addition, in the 1st stage B, the 1st pointing body 50 is lit in a light emission pattern obtained by reversing the light emission pattern of the 1st pointing body 50 in the 3rd stage of the previous period. In addition, the 3rd stage is a stage in which only the 1st pointing body 50 is lit. Therefore, the coordinate information of the detected light spot is not the reflected light of the 2nd light 180, but the coordinate information of the light spot of the 1st pointing body 50.

[0082] In addition, the 1st control section 150 lowers the light amount of the 2nd light 180 in a case where it is detected that the end switch 54 is turned on in order to make determination of the coordinate information of the 1st light 190 in the 2nd stage and the 4th stage easy. The 1st control section 150 has a 1st mode and a 2nd mode as an operation mode of controlling the light amount of the 2nd light 180.

[0083] The first control section 150 does not cause the irradiation section 133 to reduce the light quantity of the second light 180 in the case where the operation mode is the first mode. The first control section 150 causes the irradiation section 133 to reduce the light quantity of the second light 180 in the case where the operation mode is the second mode. The first control section 150 causes the light quantity of the second light 180 to be reduced to the extent that the reflected light after the second light 180 is reflected by the second indicating body 70 is not detected even if the captured image is analyzed in the second mode.

[0084] In addition, the first control section 150 causes the irradiation section 133 to stop the irradiation of the second light 180 in the case where the operation mode is shifted to the second mode. In the present embodiment, the case where the irradiation section 133 is caused to stop the irradiation of the second light 180 in the case where the operation mode is shifted to the second mode is described.

[0085] Further, the projector 100 can also accept an operation of selecting either one of the first mode and the second mode. For example, the first control section 150 can also display a user interface image for selecting the operation mode on the projection surface 10 and accept the selection by the user. The user contacts an option displayed in the user interface image by the first indicating body 50 or the second indicating body 70. The first control section 150 accepts the operation by the user to act in the selected operation mode based on the relationship between the coordinate information of the light spot and the display position of the user interface image. The option can also be the setting of contact pause and the release. The contact pause refers to a mode in which the operation of the second indicating body 70 is paused, that is, the operation of the second indicating body 70 is not detected. In addition, the first control section 150 can also change the operation mode from the first mode to the second mode in the case where the contact pause is selected by the operation of the remote controller 5. In addition, the first control section 150 changes the operation mode from the second mode to the first mode in the case where the release of the contact pause is selected by the operation of the remote controller 5.

[0086] Figure 5 is a flowchart showing the operation of the first control section 150.

[0087] Reference is made to Figure 5 The operation of the first control section 150 is described with reference to the flowchart shown in FIG. 8. First, the first control section 150 determines whether an interrupt signal is input from the capturing section 135 (step S1). The capturing section 135 captures the projection surface 10 and outputs the interrupt signal to the first control section 150 when a captured image is generated. The first control section 150 waits for the start of the process until the interrupt signal is input in the case where the interrupt signal is not input from the capturing section 135 (step S1 / No).

[0088] When the interrupt signal is input from the imaging section 135 (step S1 / Yes), the first control section 150 acquires the captured image from the imaging section 135, and determines the presence or absence of the light spot by analyzing the acquired captured image. When the light spot is detected from the captured image, the first control section 150 determines the camera coordinates of the detected light spot. Next, the coordinate information of the camera coordinates is converted into the coordinate information of the panel coordinates by the calibration data 163 (step S2).

[0089] Next, the first control section 150 determines whether the stage at which the capturing is performed is the first stage (step S3). For example, the first control section 150 determines whether the stage at which the capturing is performed is the first stage, based on the output timing of the signal light 170 and the timing at which the captured image is acquired from the imaging section 135. When it is determined that the stage at which the capturing is performed is the first stage (step S3 / Yes), the first control section 150 performs the processing corresponding to the first stage (step S4). Details of the processing corresponding to the first stage will be described with reference to the flowchart shown in Fig. 6. Figure 6

[0090] When it is determined that the stage at which the capturing is performed is not the first stage (step S3 / No), the first control section 150 determines whether the stage at which the capturing is performed is the second stage (step S5). In this case, the first control section 150 also determines whether the stage at which the capturing is performed is the second stage, based on the output timing of the signal light 170 and the timing at which the captured image is acquired from the imaging section 135. When it is determined that the stage at which the capturing is performed is the second stage (step S5 / Yes), the first control section 150 performs the processing corresponding to the second stage (step S6). Details of the processing corresponding to the second stage will be described with reference to the flowchart shown in Fig. 7. Figure 7

[0091] When it is determined that the stage at which the capturing is performed is not the second stage (step S5 / No), the first control section 150 determines whether the stage at which the capturing is performed is the third stage (step S7). In this case, the first control section 150 also determines whether the stage at which the capturing is performed is the third stage, based on the output timing of the signal light 170 and the timing at which the captured image is acquired from the imaging section 135.

[0092] When it is determined that the stage at which the capturing is performed is the third stage (step S7 / Yes), the first control section 150 performs the processing corresponding to the third stage (step S8). Details of the processing corresponding to the third stage will be described with reference to the flowchart shown in Fig. 8. Figure 8

[0093] ​​​The first control section 150 executes the process corresponding to the fourth stage (step S9) in a case where it is determined that the stage at which the photographing is performed is not the third stage (step S7 / NO). Details of the process corresponding to the fourth stage will be described with reference to the flowchart shown in Fig. 9. Figure 9

[0094] The first control section 150, after executing any of steps S4, S6, S8, and S9, next determines whether the newest storage flag is open (step S10). The storage flag is a flag that becomes open in a case where the coordinate information is stored in the storage section 160 in each of steps S4, S6, S8, and S9. In the present embodiment, the storage flag is a bit string that indicates whether the coordinate information is stored for each of the plurality of stages in succession, and is set to "1" for each stage in a case where the coordinate information is stored in the storage section 160, and is set to "0" in a case where the coordinate information is not stored in the storage section 160. In the present specification, a case where the storage flag is "1" is referred to as open, and a case where the storage flag is "0" is referred to as closed. The bit of the lowest order of the storage flag is the newest storage flag.

[0095] The first control section 150, in a case where it is determined that the newest storage flag is open (step S10 / YES), notifies the application 161 of the newest coordinate information stored in the storage section 160 and the determination result (step S11). Then, the first control section 150 changes the storage flag of the lowest order to closed (step S12). The first control section 150 sets the storage flag of the lowest order to closed by shifting the storage flag upward by one bit at a time, and setting the value of the bit of the lowest order to "0". In the determination result, for example, information indicating whether the tip switch 54 is on or off, information indicating whether the light spot is detected or not, information indicating whether the detected light spot is the light spot of the first light 190 or the light spot of the reflected light of the second light 180, and information indicating the pointer ID, and the like are included. Details of the process of obtaining these determination results will be described later.

[0096] In addition, the first control section 150, in a case where it is determined that the newest storage flag is closed (step S10 / NO), or after the process of step S12, determines whether the tip switch 54 is on (step S13). The first control section 150 acquires the determination result of whether the tip switch 54 is on or off from the storage section 160. The determination of whether the tip switch 54 is on or off is the process executed in step S9.

[0097] ​The first control section 150 determines whether the current operation mode is the first mode in the case where the determination result is that the end switch 54 is on (step S13 / Yes). The first control section 150 returns to the determination of step S1 in the case where it is determined that the operation mode is not the first mode but the second mode (step S14 / No).

[0098] In addition, the first control section 150 changes the operation mode to the second mode in the case where it is determined that the current operation mode is the first mode (step S14 / Yes) (step S15), and causes the irradiation section 133 to stop the output of the second light 180 (step S16). Then, the first control section 150 returns to the determination of step S1.

[0099] In addition, the first control section 150 determines whether the current operation mode is the second mode in the case where it is determined that the end switch 54 is off in step S13 (step S13 / No) (step S17). The first control section 150 returns to the determination of step S1 in the case where it is determined that the operation mode is not the second mode but the first mode (step S17 / No).

[0100] In addition, the first control section 150 determines whether the counter is in the count down in the case where it is determined that the current operation mode is the second mode (step S17 / Yes) (step S18). The first control section 150 sets a prescribed value to the counter and starts the count down in the case where it is determined that the counter is not in the count down (step S18 / No) (step S19). Then, the first control section 150 returns to the determination of step S1.

[0101] In addition, the first control section 150 determines whether the count value of the counter is 0 in the case where it is determined that the counter is in the count down in the determination of step S18 (step S18 / Yes) (step S20). The first control section 150 returns to the determination of step S1 in the case where it is determined that the count value of the counter is not 0 (step S20 / No). In addition, the first control section 150 changes the operation mode from the second mode to the first mode in the case where it is determined that the count value of the counter is 0 (step S20 / Yes) (step S21). Then, the first control section 150 causes the irradiation section 133 to restart the output of the second light 180 (step S22), and returns to the determination of step S1. That is, the projector 100 changes the operation mode to the first mode and restarts the detection of the indication position of the second indicator 70 if the state where the drawing is not performed continues for a prescribed time while operating in the second mode.

[0102] Next, step S4, S6, S8, and S9 will be described. Figure 6 is a flowchart showing the details of step S4, that is, the flow of the first stage of operation of the first control section 150. Figure 5 is a flowchart showing the details of step S4, that is, the flow of the first stage of operation of the first control section 150.

[0103] The first control section 150 causes the storage section 160 to store the presence or absence of the light spot detected in the first stage this time (step S401). The first control section 150 acquires the coordinate information of the panel coordinates of the light spot in step S2, and in the case where the coordinate information of the light spot determined to be the first indicator 50 in the most recent prescribed period is stored in the storage section 160, compares the latest coordinate information with the coordinate information this time. In the case where the result of the comparison is that the coordinate this time is within a prescribed range from the coordinate of the comparison target, it is determined that the light spot is detected, and information indicating the presence of the light spot is stored in the storage section 160. In the case where the coordinate this time is not within the prescribed range, it is determined that the light spot is not detected, and information indicating the absence of the light spot is stored in the storage section 160. In the case where the coordinate information of the panel coordinates of the light spot is acquired in step S2, and there is no coordinate information as a comparison target, it is considered that the light spot this time is not noise, and information indicating the presence of the light spot is stored in the storage section 160. In addition, the first control section 150 stores information indicating the absence of the light spot in the storage section 160 in the case where the light spot is not detected in step S2. In addition, the determination result of the presence or absence of the light spot includes information indicating the presence or absence of the light spot for a prescribed number of consecutive stages.

[0104] Next, the first control section 150 refers to the determination result stored in step S401, and determines whether there is a light spot detected in the first stage this time (step S402).

[0105] The first control section 150 transitions to step S10 in the case where it is determined that there is no light spot (step S402 / No). In addition, the first control section 150 determines whether the current operation mode is the second mode in the case where it is determined that there is a light spot (step S402 / Yes) (step S403). In the case where it is determined that the operation mode is not the second mode but the first mode (step S403 / No), it transitions to step S10. In the case where it is determined that the operation mode is the second mode (step S403 / Yes), it determines whether the storage flag of the immediately preceding stage is off (step S404). In the first stage, since the immediately preceding stage is the fourth stage of the immediately preceding period, it determines whether the storage flag of the fourth stage is off. In the case where the storage flag is on, it is determined that the storage flag is not off (step S404 / No), and it transitions to step S10.

[0106] When the storage flag is determined to be off (step S404 / Yes), the first control section 150 temporarily stores the coordinate information of the light spot detected in the first stage of this time in the storage section 160 (step S405). The first control section 150 temporarily stores the coordinate information of the light spot detected in the first stage in the storage section 160 to output it to the application 161. Then, the first control section 150 changes the lowest bit of the storage flag from off to on (step S406). Then, the processing proceeds to step S10.

[0107] Figure 7 is a flowchart showing the details of step S6, that is, the flow of the action of the second stage of the first control section 150. Figure 5

[0108] The first control section 150 causes the storage section 160 to store the presence or absence of the light spot detected in the second stage of this time (step S601). The method of determining the presence or absence of the light spot is the same as that of step S402. However, in the second stage, the reflected light of the first light 190 and the second light 180 can be detected. Therefore, the first control section 150 compares the light spot detected in the second stage with the coordinate of the comparison object of the light spot determined to be the first light 190 and the coordinate of the comparison object of the light spot determined to be the reflected light of the second light 180. Then, the light spot of this time within the prescribed range from any coordinate is determined to be the light spot of the first light 190 or the reflected light of the second light 180. In a case where neither of the light spots is detected, and in a case where the detected light spot is determined not to be within the prescribed range from any of the first light 190 and the reflected light of the second light 180, information indicating the absence of the light spot is stored in the storage section 160.

[0109] Next, the first control section 150 refers to the determination result stored in step S601 to determine whether there is the light spot detected in the second stage of this time (step S602). When the first control section 150 determines that there is no light spot (step S602 / No), the processing proceeds to step S10. When the first control section 150 determines that there is the light spot (step S602 / Yes), the first control section 150 causes the storage section 160 to store the panel coordinates of the light spot (step S603), and then the first control section 150 changes the lowest bit of the storage flag from off to on (step S604). Then, the processing proceeds to step S10.

[0110] Figure 8 is a flowchart showing the details of step S8, that is, the flow of the action of the third stage of the first control section 150. Figure 5

[0111] ​​The first control section 150 causes the storage section 160 to store the presence or absence of the light point detected in the third stage this time (step S801). The processing of step S801 is the same as that of step S401.

[0112] Next, the first control section 150 refers to the determination result stored in step S801, and determines whether there is a light point detected in the third stage this time (step S802). The first control section 150, in the case where it is determined that there is no light point (step S802 / No), shifts to step S807.

[0113] In addition, the first control section 150, in the case where it is determined that there is a light point (step S802 / Yes), determines whether the current operation mode is the second mode (step S803). In the case where it is determined that the operation mode is not the second mode but the first mode (step S803 / No), it shifts to step S807. In the case where it is determined that the operation mode is the second mode (step S803 / Yes), it determines whether the storage flag of the immediately previous stage is off (step S804). In the third stage, since the previous stage is the second stage of the current period, it determines whether the storage flag of the second stage is off. In the case where the storage flag is on, it is determined that the storage flag is not off (step S804 / No), and it shifts to step S807.

[0114] The first control section 150, in the case where it is determined that the storage flag is off (step S804 / Yes), causes the storage section 160 to store the coordinate information of the light point detected in the third stage this time (step S805). Then, the first control section 150 changes the lowest bit of the storage flag from off to on (step S806).

[0115] Next, the first control section 150 determines the light points of the first pointer 50 and the second pointer 70 (step S807). The first control section 150 determines the coordinates of the light point of the first pointer 50 as the coordinates of the light point detected in the second and fourth stages and the light point detected in the first or third stage. In addition, the first control section 150 determines the coordinates of the light point of the second pointer 70 as the coordinates of the light point detected in the second and fourth stages and the light point not detected in the third stage.

[0116] The first control section 150 stores the determination result in the storage section 160 (step S808). The first control section 150 stores information indicating whether the pointer is the first pointer 50 or the second pointer 70 in the storage section 160 in correspondence with the coordinate information of the light point.

[0117] Next, in step S809, the first control unit 150 refers to the information stored in the storage unit 160 to determine whether there are coordinates of a light spot determined to be the first indicator 50 (step S809). If no coordinates of a light spot determined to be the first indicator 50 are found (step S809 / No), the first control unit 150 proceeds to the determination in step S10. Alternatively, if coordinates of a light spot determined to be the first indicator 50 are found (step S809 / Yes), the first control unit 150 determines the indicator ID set for the first indicator 50 (step S810).

[0118] The first control unit 150 determines the indicator ID set for the first indicator 50 based on the detection results of the light spot in the third stage preceding the coordinates of the light spot determined to be the first indicator 50. For example, when the end switch 54 is turned on, the first control unit 150 refers to the determination results stored in step S801 and step S808 to obtain information on the presence or absence of light emission at the same coordinates in the third stage of three consecutive periods, thereby determining the light emission mode of one first indicator 50. For example, if the light emission mode matches any of the multiple indicator IDs pre-stored in the storage unit 160, that indicator ID is determined to be the indicator ID of the first indicator 50. For example, if the light emission mode is "001" and matches the stored indicator ID, the coordinates of the light spot of the first indicator 50 with indicator ID "001" are determined.

[0119] Furthermore, if the light emission mode is an inversion of any mode among the pre-stored indicator IDs, the first control unit 150 determines that the inversion of the light emission mode is the indicator ID of the first indicator 50. For example, if the light emission mode is "110", it determines that the coordinates of the light spot of the first indicator 50 with indicator ID "001" are correct.

[0120] If the first control unit 150 determines the indicator ID of the first indicator 50, it stores the determined indicator ID in the storage unit 160 along with the coordinate information. If the first control unit 150 cannot determine the indicator ID, it stores the undetermined information in the storage unit 160 along with the coordinate information (step S811). Then, the process proceeds to step S10.

[0121] Figure 9 It means Figure 5 The flowchart shows the details of step S9, that is, the operation of the fourth stage of the first control unit 150.

[0122] The first control section 150 causes the storage section 160 to store the presence or absence of the light spot detected in this time's fourth stage (step S901). The method of determining the presence or absence of the light spot is the same as that in step S601. Next, the first control section 150 refers to the determination result stored in step S901, and determines whether there is a light spot detected in this time's fourth stage (step S902). The first control section 150 transitions to step S10 in the case where it is determined that there is no light spot (step S902 / No). The first control section 150 causes the storage section 160 to store the panel coordinates of the light spot in the case where it is determined that there is a light spot (step S902 / Yes). Next, the first control section 150 changes the bit of the lowest order of the storage flag from off to on (step S904).

[0123] The first control section 150 determines whether the end switch 54 is on or off when changing the storage flag to on (step S905). The first control section 150 determines that the end switch 54 is off in the case where the emission pattern obtained in step S810 coincides with the indicator ID. In addition, the first control section 150 determines that the end switch 54 is on in the case where the emission pattern coincides with the inversion of the indicator ID. The first control section 150 stores the determination result of the state of the end switch 54 in the storage section 160 (step S906). Then, the processing transitions to step S10.

[0124] As described above, the projector 100 of the present embodiment has the first control section 150 that executes the first mode and the second mode.

[0125] The first control section 150, in the case where the first mode is executed, executes: detecting the first light 190 emitted by the first indicator 50, thereby detecting the position of the first indicator 50 on the projection surface 10; and causing the irradiation section 133 to emit the second light 180, and detecting the reflected light of the second light 180 reflected by the second indicator 70, thereby detecting the position of the second indicator 70 on the projection surface 10.

[0126] In addition, the first control section 150, in the case where the second mode is executed, executes: reducing the light quantity of the second light 180 in the case where it is determined that the first indicator 50 is in contact with the projection surface 10; and detecting the first light 190 in the state where the light quantity of the second light 180 is reduced, thereby detecting the position of the first indicator 50 on the projection surface 10.

[0127] Therefore, in the case where it is determined that the first indicator 50 is in contact with the projection surface 10, the light quantity of the second light 180 for detecting the position of the second indicator 70 is reduced, and thus it is easy to detect the first light 190 emitted by the first indicator 50. Therefore, it is possible to suppress a decrease in the detection accuracy of the operation of the first indicator 50.

[0128] The first control section 150 stops the emission of the second light 180 by the irradiation section 133 in the case where the amount of light of the second light 180 is reduced.

[0129] Therefore, it is easier to detect the first light 190 emitted from the first indicating body 50.

[0130] The first control section 150 reduces the amount of light of the second light 180 to an amount of light at which reflected light thereof cannot be detected in the case where the amount of light of the second light 180 is reduced.

[0131] Therefore, in the case where it is determined that the first indicating body 50 is in contact with the projection surface 10, the amount of light of the second light 180 is reduced to an amount of light at which reflected light after reflection by the second indicating body 70 cannot be detected, and thus it is easier to detect the first light 190 emitted from the first indicating body 50. Therefore, it is possible to suppress a decrease in the detection accuracy of the operation of the first indicating body 50.

[0132] The first control section 150 receives an operation of selecting either the first mode or the second mode.

[0133] Therefore, by the operation of the user, it is possible to switch the mode of the first control section 150 to the first mode or the second mode. Therefore, by manually changing to the second mode according to the judgment of the user, it is possible to easily detect the first light 190 emitted from the first indicating body 50.

[0134] The light emission mode of the first indicating body 50 and the irradiation section 133 includes a first period and a second period.

[0135] The first period is the first stage or the third stage in which the first indicating body 50 emits the first light 190 and the irradiation section 133 stops the emission of the second light 180.

[0136] In addition, the second period is the second stage and the fourth stage in which the first indicating body 50 emits the first light 190 and the irradiation section 133 emits the second light 180 in the first mode.

[0137] The first control section 150 determines whether or not the first light 190 is detected in the first stage or the third stage.

[0138] With regard to the detection of the position of the first indicating body 50, in the case where it is determined that the first indicating body 50 is detected in the second stage or the fourth stage, the position of the first indicating body 50 is output according to the position of the light detected in the second stage or the fourth stage.

[0139] Therefore, in the first mode, in the case where the first light 190 is detected in the second stage or the fourth stage, the position of the first indicating body 50 is output according to the position of the light detected in the second stage or the fourth stage, and thus it is possible to detect the position of the first indicating body 50.

[0140] Further, the first control section 150 outputs the position of the first indicating body 50 based on the position of the first light 190 detected in the first stage or the third stage when detecting the position of the first indicating body 50.

[0141] Therefore, in the second mode, the position of the first indicating body 50 is output based on the position of the first light 190 detected in the first stage or the third stage in which the second light 180 is not emitted, and thus the detection accuracy of the position of the first indicating body 50 can be improved.

[0142] The projection system 1 includes: the first indicating body 50 that emits the first light 190; the irradiation section 133 that emits the second light 180; the first control section 150 that operates in a first mode and a second mode, the first mode including: detecting the first light 190 emitted from the first indicating body 50, thereby detecting the position of the first indicating body 50 on the projection surface 10, and detecting the reflected light of the second light 180 reflected by the second indicating body 70, thereby detecting the position of the second indicating body 70 with respect to the projection surface 10, the second mode including: reducing the light amount of the second light 180 in a case where it is determined that the first indicating body 50 is in contact with the projection surface 10, and detecting the first light 190 in a state where the light amount of the second light 180 is reduced, thereby detecting the position of the first indicating body 50 on the projection surface 10; and the optical device that projects the image light to the projection surface 10 based on the position of the first indicating body 50 or the position of the second indicating body 70.

[0143] Therefore, in a case where the first indicating body 50 is in contact with the projection surface 10, the light amount of the second light 180 used for detecting the position of the second indicating body 70 is reduced, and thus the first light 190 emitted from the first indicating body 50 is easily detected. Therefore, the detection accuracy of the operation of the first indicating body 50 can be suppressed from decreasing.

[0144] The above-described embodiment is a preferred embodiment of the present application. However, the present application is not limited to this embodiment, and various modifications can be implemented without departing from the gist of the present application.

[0145] For example, in the above-described embodiment, the structure in which the projector 100 has the irradiation section 133 and the photographing section 135 is described, but at least one of the irradiation section 133 and the photographing section 135 can be provided as a separate light emitting device outside the projector 100. Further, a part of the functions of the first control section 150 can be mounted on a separate device provided outside the projector 100. In a case where these structures are provided outside the projector 100, they can be provided as separate devices, or they can be provided as a device including two or more of these structures.

[0146] In addition, in the above-described embodiment, the projector 100 is described as a liquid crystal projector using a transmissive liquid crystal panel, but it can also be a projector using a reflective liquid crystal panel or a digital micromirror device.

[0147] In addition, Figure 3 The functional sections of the first pointing body 50 shown are functional structures realized by cooperation of hardware and software, and the specific installation method is not particularly limited. Therefore, hardware corresponding to each functional section does not necessarily need to be installed separately, and of course, it can also be configured so that a single processor executes programs to realize the functions of multiple functional sections. Furthermore, in the above-described embodiment, a part of the functions realized by software can be realized by hardware, or a part of the functions realized by hardware can be realized by software.

[0148] In addition, for example, in Figure 3 In the structure of the first pointing body 50 shown, at least a part of the receiving section 53, the second control section 58, the power supply section 57, and the tip switch 54 can be configured by an integrated circuit or other digital circuit, and an analog circuit can be included in at least a part of each section. The integrated circuit includes an LSI (Large Scale Integration), an ASIC, and a PLD (Programmable Logic Device). The PLD includes, for example, an FPGA. Each of the above-described sections can also be a combination of a processor and an integrated circuit. The combination is referred to as, for example, an MCU (Micro Control Unit), an SoC (System-on-a-Chip), a system LSI, a chipset, and the like.

[0149] Furthermore, in Figure 3 In the structure of the projector 100 shown, at least a part of the transmission section 131, the irradiation section 133, and the first control section 150 can be configured by an integrated circuit IC or other digital circuit, and an analog circuit can be included in at least a part of each section. Furthermore, each of the above-described sections can also be configured by a combination of a processor and an integrated circuit.

[0150] In addition, it can also be configured in the form of a program executed by a computer in order to realize the above-described pointing body detection method, a recording medium in which the program can be read by the above-described computer, or a transmission medium that transmits the program.

[0151] In addition, Figures 5-9 The processing units of the flowchart shown are units divided according to the main processing content in order to easily understand the processing of the first control section 150, and the present application is not limited to Figures 5-9The division of the processing units shown in the flowchart, the name restriction. In addition, the processing of the first control section 150 can be divided into more processing units according to the processing content, or more processing can be included in one processing unit. In addition, the processing order of the above flowchart is not limited to the example shown in the figure.

Claims

1. A pointing body detection method including a first mode and a second mode, wherein the first mode includes: detecting first light emitted by a first pointing body, thereby detecting a position of the first pointing body on an operation surface, the light emitting device emitting second light, detecting reflected light of the second light reflected by a second pointing body, thereby detecting a position of the second pointing body on the operation surface, the second mode includes: reducing an amount of light of the second light in a case where it is determined that the first pointing body is in contact with the operation surface, detecting the first light in a state where the amount of light of the second light is reduced, thereby detecting a position of the first pointing body on the operation surface, the pointing body detection method includes changing from the second mode to the first mode in a case where a state where the first pointing body does not trace the operation surface in the second mode continues for a prescribed time.

2. The pointing body detection method according to claim 1, wherein the reducing of the amount of light of the second light means that the light emitting device stops the emission of the second light.

3. The pointing body detection method according to claim 1, wherein the reducing of the amount of light of the second light means reducing the amount of light of the second light to an amount of light at which the reflected light is not detected.

4. The pointing body detection method according to any one of claims 1 to 3, wherein the pointing body detection method further includes accepting an operation of selecting any one of the first mode and the second mode. The pointing body detection method further includes: in a first period, the first pointing body emitting the first light, the light emitting device stopping the emission of the second light, in a second period, the first pointing body emitting the first light, the light emitting device emitting the second light in the first mode, determining whether the first light is detected in the first period, detecting a position of the first pointing body in the first mode includes, in a case where it is determined that the first light is detected, outputting the position of the first pointing body based on a position of light detected in the second period.

6. The pointing body detection method according to claim 5, wherein the detecting of the position of the first pointing body in the second mode includes outputting the position of the first pointing body based on a position of the first light detected in the first period. The projection system includes: a first pointing body that emits first light; a light emitting device that emits second light; a control section that operates in a first mode and a second mode, the first mode includes: detecting the first light emitted by the first pointing body, thereby detecting a position of the first pointing body on an operation surface, detecting reflected light of the second light reflected by a second pointing body, thereby detecting a position of the second pointing body with respect to the operation surface, the second mode includes: reducing an amount of light of the second light in a case where it is determined that the first pointing body is in contact with the operation surface, detecting the first light in a state where the amount of light of the second light is reduced, thereby detecting a position of the first pointing body on the operation surface, and The projection system includes: a first pointing body that emits first light; a light emitting device that emits second light; a control section that operates in a first mode and a second mode, the first mode includes: detecting the first light emitted by the first pointing body, thereby detecting a position of the first pointing body on an operation surface, detecting reflected light of the second light reflected by a second pointing body, thereby detecting a position of the second pointing body with respect to the operation surface, the second mode includes: reducing an amount of light of the second light in a case where it is determined that the first pointing body is in contact with the operation surface, detecting the first light in a state where the amount of light of the second light is reduced, thereby detecting a position of the first pointing body on the operation surface, and ​ ​ ​ ​ ​ ​ ​ 5. The method of detecting an indicator body according to any one of claims 1 to 3, wherein ​ ​ ​ ​ ​ ​ ​ 7. A projection system, wherein, ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ an optical device that projects image light to the operation surface based on the position of the first pointing body or the position of the second pointing body, the control section changes the operation mode of the control section from the second mode to the first mode when the state in which the first pointing body does not trace the operation surface in the second mode continues for a prescribed time.

Images