Display method and projection device

Abstract

To solve the problem that although the settings of thickness, color, etc., of lines are possibly made before drawing, a display of the settings before the drawing is not taken into consideration.SOLUTION: A display method includes: determining whether an indication body is in contact with a display surface where an object is displayed; if it is determined that the indication body is not in contact with the display surface, determining a distance from the indication body to the display surface in a state in which the indication body is not in contact with the display surface; if it is determined that the distance is a second distance smaller than a predetermined first distance, displaying an operation image capable of accepting property settings of the object drawn on the display surface with the indication body on the display surface; and if it is determined that the indication body is in contact with the display surface, accepting a drawing operation to draw the object on the display surface, or a setting operation on the operation image.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present disclosure relates to a display method and a projection device. [Background technology]

[0002] There is known an information display system that draws a locus of a pointer point. The information display system described in Patent Document 1 has a drawing function that creates an image with a predetermined icon displayed near the pointer point. The predetermined icon is a menu icon that displays a menu screen, or a toggle switch icon that changes the settings of the locus line, etc. The icon is displayed at a position that follows the pointer point and does not interfere with drawing. The user can change the settings of the locus line while drawing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-53584 A Summary of the Invention [Problem to be solved by the invention]

[0004] Settings such as line thickness and color are likely to be made before drawing, but display of settings before drawing is not taken into consideration. [Means for solving the problem]

[0005] The display method of the present disclosure includes determining whether or not an indicator is in contact with a display surface on which an object is displayed, determining a distance from the indicator to the display surface when it is determined that the indicator is not in contact with the display surface, determining a distance from the indicator to the display surface in a state in which the indicator is not in contact when it is determined that the indicator is not in contact with the display surface, displaying an operation image on the display surface that can accept attribute settings of the object to be drawn on the display surface by the indicator when it is determined that the indicator is in contact with the display surface, or accepting a drawing operation to draw the object on the display surface or a setting operation for the operation image.

[0006] The projection device of the present disclosure is a projection device having one or more processors, which determine whether or not a pointer is in contact with a display surface on which an object is displayed, and, if it is determined that the pointer is not in contact with the display surface, display on the display surface an operation image capable of accepting attribute settings of the object to be drawn on the display surface, and, if it is determined that the pointer is in contact with the display surface, accept a drawing operation to draw the object on the display surface or a setting operation for the operation image. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a projection system. [Diagram 2] FIG. 1 is a diagram showing a schematic configuration of a projection system. [Diagram 3] FIG. 1 is a block diagram showing the configuration of a projection system. [Figure 4] FIG. 2 is a diagram showing a projection image projected by a projector. [Diagram 5] FIG. 4 is a diagram showing a schematic configuration of an operation screen. [Figure 6] FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 7] FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 8]FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 9] FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 10] FIG. 4 is a diagram showing a control flow of the projector. [Figure 11] FIG. 4 is a diagram showing a control flow of the projector. [Figure 12A] 4A and 4B are diagrams showing the relationship between the operation pen and a projection surface. [Figure 12B] 4A and 4B are diagrams showing the relationship between the operation pen and a projection surface. [Figure 13A] FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 13B] FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 14] FIG. 2 is a diagram showing a projection image projected by a projector. [Figure 15] FIG. 2 is a diagram showing a projection image projected by a projector. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Fig. 1 shows a schematic configuration of a projection system 100. Fig. 1 is a perspective view showing an installation state of each unit of the projection system 100. The projection system 100 includes a projector 1 and a projection screen 2. The projection system 100 corresponds to an example of a display system.

[0009] Several figures including FIG. 1 show an XYZ coordinate system. The Z axis is an axis perpendicular to the projection screen 2. The +Z direction is a direction from the projection screen 2 toward the front. The -Z direction is a direction from the projection screen 2 toward the back. The X axis is parallel to the projection screen 2. The X axis is an axis perpendicular to the Y axis. The +X direction is a direction from the left to the right of the projection screen 2. The -X direction is a direction from the right to the left of the projection screen 2. The Y axis is parallel to the projection screen 2. The Y axis is an axis perpendicular to the X axis and the Z axis. The +Y direction is a direction from the bottom to the top of the projection screen 2. The -Y direction is a direction from the top to the bottom of the projection screen 2. The +Z direction is an example of a first direction perpendicular to the projection surface 2S described later. In addition, the plane formed by the X axis and the Y axis is called the XY plane.

[0010] The projector 1 generates image light corresponding to image data. The projector 1 emits the generated image light onto a projection surface 2S of a projection screen 2. The projector 1 projects a projection image PG onto the projection surface 2S by emitting the image light to the projection surface 2S. The projector 1 corresponds to an example of a projection device.

[0011] The projector 1 has an interactive function. The interactive function includes a function of writing an image on the projection image PG, a function of performing a gesture operation on the projection image PG, and the like. The projector 1 detects a position specified by a finger 5 or an operation pen 7. The projector 1 projects an image corresponding to the movement trajectory of the finger 5 or the like on the projection surface 2S based on the detected position. Alternatively, the projector 1 changes the position, shape, and the like of a drawn image DG included in the projection image PG based on the detected position. The drawn image DG corresponds to an example of an object.

[0012] The projection screen 2 has a projection surface 2S. The projection screen 2 shown in FIG. 1 is disposed at a position in the -Z direction and the -Y direction of the projector 1. The projection screen 2 shown in FIG. 1 is made of a plate-like member, but is not limited to this. The projection screen 2 may be made of cloth or the like. The projection screen 2 may be a wall surface or a floor of a building. The projection screen 2 corresponds to an example of a screen.

[0013] The projection surface 2S displays a projection image PG including a drawn image DG. The projection surface 2S shown in FIG. 1 is a flat surface, but is not limited thereto. The projection surface 2S may be configured as a curved surface or a surface having projections and recesses. The projection surface 2S corresponds to an example of a display surface.

[0014] FIG. 1 shows a user's finger 5. The finger 5 indicates a position on the projection surface 2S, or a spatial area in the +Z direction of the projection surface 2S. Although FIG. 1 shows a finger 5, this is not limited to this. Instead of the finger 5, an operation pen 7, which will be described later, may be used. As long as the configuration allows the position on the projection surface 2S, or the spatial area in the +Z direction of the projection surface 2S to be specified, the form is not limited. The finger 5 and the operation pen 7 correspond to examples of an indicator.

[0015] Fig. 2 shows a schematic configuration of the projection system 100. Fig. 2 shows the configuration of the projection system 100 as viewed from the +X direction. Fig. 2 shows the projector 1 that emits detection light LT. The projector 1 has a signal light transmitting unit 13.

[0016] The signal light transmitter 13 emits detection light LT toward the projection surface 2S. The signal light transmitter 13 emits detection light LT to an area including a projection area where the projector 1 projects image light onto the projection surface 2S. The detection light LT is light used to detect the finger 5 and the operation pen 7. The signal light transmitter 13 emits infrared light as the detection light LT.

[0017] When the user's finger 5 is positioned within a detection area LA of the detection light LT, it blocks the detection light LT. The detection light LT hits the finger 5 and is reflected. A part of the reflected light travels from the finger 5 toward the projector 1. The projector 1 receives the reflected light reflected by the finger 5 positioned within the detection area LA. The detection area LA is an area between the projection surface 2S and a first virtual surface VS1. The first virtual surface VS1 is a surface that is parallel to the projection surface 2S and is separated by a detection distance dt1 in the +Z direction. The detection distance dt1 is set in advance according to the installation position of the projector 1 or the image capture unit 15 described later. The projector 1 detects the position indicated by the finger 5 based on the reflected light.

[0018] 2 shows a finger 5, but an operation pen 7 may be used instead of the finger 5. The signal light transmission unit 13 shown in Fig. 2 is disposed in the projector 1, but is not limited to this. As an example, the signal light transmission unit 13 may be disposed at a position along the projection surface 2S.

[0019] Fig. 3 shows a block configuration of the projection system 100. Fig. 3 shows a manipulation pen 7 instead of a finger 5. The projection system 100 shown in Fig. 3 includes a projector 1, a projection screen 2, the manipulation pen 7, and a remote control 17.

[0020] The operation pen 7 indicates the position specified by the user, similar to the finger 5. The position of the pen tip of the operation pen 7 indicates the position specified by the user. The pen tip of the operation pen 7 may emit pattern light of a predetermined light emission pattern. As an example, the pattern light indicates that the pen tip is in contact with the projection surface 2S and that the pen tip is separated from the projection surface 2S. The pattern light may also indicate that the pen tip is separated from the projection surface 2S by a distance equal to or less than a predetermined distance.

[0021] The projector 1 includes a remote control light receiving unit 11, a signal light transmitting unit 13, an image capturing unit 15, a wireless communication unit 20, an image projection device 30, an image generation device 40, and a control device 50.

[0022] The remote control light receiving unit 11 receives an operation signal transmitted from the remote control 17. The remote control light receiving unit 11 accepts a user operation by receiving the operation signal transmitted from the remote control 17. The operation signal is a signal corresponding to an operation performed by the user on the remote control 17. The received operation signal is an infrared signal, a Bluetooth signal, etc. Bluetooth is a registered trademark. The remote control light receiving unit 11 may generate a signal corresponding to the received operation signal. The remote control light receiving unit 11 transmits the operation signal to the control device 50.

[0023] The signal light transmitting unit 13 emits detection light LT. When the projector 1 detects the position of the operation pen 7, the signal light transmitting unit 13 may transmit signal light that synchronizes the light emission timing of the operation pen 7 with the shooting timing of the shooting unit 15. The signal light is near-infrared light having a predetermined light emission pattern. As an example, the pen tip of the operation pen 7 emits pattern light of a predetermined light emission pattern in synchronization with the timing of receiving the signal light. The light emission pattern of the pattern light differs depending on whether the pen tip of the operation pen 7 is in contact with the projection surface 2S or not.

[0024] The photographing unit 15 photographs the finger 5, the operation pen 7, etc. The photographing unit 15 may receive a pattern light emitted by the tip of the operation pen 7. The photographing unit 15 has a photographing element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device). The photographing unit 15 photographs an area including the projection surface 2S at regular time intervals based on the control of the control device 50, and generates photographed data. When the user operates the finger 5 or the operation pen 7, the photographing unit 15 generates one or more pieces of photographed data as information related to the operation. The photographing unit 15 transmits the photographed data to the control device 50.

[0025] The projector 1 detects the distance between the finger 5 and the projection surface 2S in the +Z direction by triangulation using a known stereo camera, for example. Specifically, the projector 1 includes a first camera and a second camera (not shown) arranged at different positions as the image capturing unit 15, and calculates the distance A from the first camera and the second camera to the finger 5 using a first captured image captured by the first camera, a second captured image captured by the second camera, the distance between the first camera and the second camera, and internal parameters of the first camera and the second camera. The first captured image and the second captured image are images of infrared light of the finger 5 reflecting the detection light LT. In addition, the user or the like measures the distance B from the first camera and the second camera to the projection surface 2S in advance, and the projector 1 determines the distance B - distance A as the distance between the finger 5 and the projection surface 2S. Both the first camera and the second camera are infrared cameras. The first and second cameras may both be visible light cameras, or one may be a visible light camera and the other an infrared camera. When at least one of the first and second cameras is a visible light camera, the projector 1 may be provided with a visible light source, or the illumination light in the room where the projector 1 is installed may be used as the light source. The projector 1 may detect the distance between the operation pen 7 and the projection surface 2S by, for example, triangulation using the above-mentioned stereo camera.

[0026] The wireless communication unit 20 is an interface circuit that wirelessly connects to an external device for communication. The wireless communication unit 20 connects to the external device according to a predetermined communication protocol. The wireless communication unit 20 executes wireless communication such as wireless LAN (Local area network) including Wi-Fi, Bluetooth, and NFC (Near Field Communication). Wi-Fi is a registered trademark. The wireless communication unit 20 receives a communication signal. The wireless communication unit 20 demodulates packet data from the communication signal. The wireless communication unit 20 extracts image data and various signals from the packet data. The wireless communication unit 20 transmits the image data to the image processing unit 41.

[0027] The image projection device 30 projects image light onto the projection surface 2S. The image projection device 30 projects a projection image PG onto the projection surface 2S by projecting the image light. The image projection device 30 includes a light source 31, a light modulation device 33, and an optical unit .

[0028] The light source 31 emits light to the light modulation device 33. The light source 31 is constituted by a lamp light source such as a halogen lamp, a xenon lamp, an extra-high pressure mercury lamp, etc. The light source 31 may be constituted by a solid-state light source such as an LED (Light Emitting Diode) or a laser light source.

[0029] The light modulation device 33 has a light modulation element. The light modulation element modulates the light emitted from the light source 31. The light modulation element is composed of a transmissive liquid crystal light valve, a reflective liquid crystal light valve, a digital mirror device, etc. The light modulation device 33 emits the image light modulated by the light modulation element to the optical unit 35.

[0030] The optical unit 35 has optical elements such as lenses and mirrors. The optical unit 35 emits the image light modulated by the light modulation device 33 toward the projection surface 2S. The optical unit 35 emits the image light toward the projection surface 2S, thereby projecting a projection image PG onto the projection surface 2S.

[0031] The image generating device 40 generates various images to be projected onto the projection surface 2S by the image projection device 30. The image generating device 40 has an image processing unit 41, an OSD synthesis unit 43, and a frame memory 45. In the projector 1 shown in FIG. 3, the image generating device 40 and the control device 50 are shown as separate entities, but they may be configured as an integrated unit.

[0032] The image processing unit 41 expands the image data received from the wireless communication unit 20 in the frame memory 45. The image processing unit 41 performs image processing on the expanded image data. The image processing includes at least one of resolution conversion processing, resizing processing, correction processing for distortion aberration, shape, etc., digital zoom processing, and adjustment processing for image color, brightness, etc. The image processing unit 41 may perform image processing based on various data received from the control device 50. The image processing unit 41 is an arithmetic processing device configured with a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a microcomputer, etc.

[0033] The OSD synthesis unit 43 synthesizes OSD data in the frame memory 45. OSD is an abbreviation for On Screen Display. The OSD data includes data for displaying various icons, display screens, etc. in the projection image PG. The OSD synthesis unit 43 is a calculation processing device constituted by a CPU, a GPU, a microcomputer, etc. The OSD synthesis unit 43 may be constituted by the same calculation processing device as the image processing unit 41.

[0034] The frame memory 45 expands image data, OSD data, etc. The frame memory 45 is connected to the image processing unit 41 and the OSD synthesis unit 43. The frame memory 45 expands image data based on the control of the image processing unit 41 and the OSD synthesis unit 43. The frame memory 45 is composed of a semiconductor memory such as a RAM (Random Access Memory).

[0035] The control device 50 is a controller that controls each part of the projector 1. The control device 50 controls the projection image PG projected onto the projection surface 2S by the image projection device 30. The control device 50 controls the image generation device 40, and controls various images displayed within the projection image PG. The control device 50 detects the finger 5 and the operation pen 7, and performs various controls based on the detection results. The control device 50 has a memory unit 60 and one or more control processors 70.

[0036] The storage unit 60 stores various data such as OSD data, various programs, etc. The storage unit 60 stores the photographed data transmitted from the photographing unit 15. The storage unit 60 may store image data received by the wireless communication unit 20. The storage unit 60 is composed of a volatile semiconductor memory such as a RAM, and a non-volatile memory such as a Read Only Memory (ROM) or a flash memory. The storage unit 60 may have a magnetic memory such as a Hard Disk Drive (HDD). The storage unit 60 stores a control program CP.

[0037] The control program CP is firmware that causes the control processor 70 to operate as various functional units. The control program CP, when executed by the control processor 70, causes the control processor 70 to operate as various functional units.

[0038] One or more control processors 70 are configured with a CPU, a microcomputer, etc. The control processor 70 operates as various functional units by executing a control program CP. The control processor 70 functions as a communication control unit 71, a drawing control unit 73, and a determination unit 75. The control processor 70 may function as a functional unit other than the communication control unit 71, the drawing control unit 73, and the determination unit 75. The control processor 70 corresponds to an example of a processor.

[0039] The communication control unit 71 controls communication with an external device via the wireless communication unit 20. The communication control unit 71 controls the wireless communication unit 20 to receive various data from the external device. The communication control unit 71 transmits various data via the wireless communication unit 20.

[0040] The drawing control unit 73 receives the photographed data. By acquiring the photographed data, the drawing control unit 73 accepts various operations by the user. The drawing control unit 73 performs drawing processing based on the photographed data. The drawing processing includes various settings related to drawing. The drawing control unit 73 controls the display of various icons and various display screens related to the drawing processing. The drawing control unit 73 performs various controls based on the judgment data and position data transmitted from the judgment unit 75.

[0041] The determination unit 75 receives the photographed data. The determination unit 75 detects the position of the finger 5 or the operation pen 7 as position data based on the photographed data. The position data is data indicating the position of the finger 5 or the operation pen 7. The determination unit 75 detects position data in which a predetermined position in the finger 5 and a predetermined position in the operation pen 7 are detected as detected positions. As an example, the determination unit 75 detects position data in which the tip of the finger 5 and the position of the pen tip of the operation pen 7 are detected as detected positions. The determination unit 75 transmits the position data to the drawing control unit 73. The determination unit 75 generates position data at predetermined time intervals.

[0042] The determination unit 75 determines whether or not the finger 5 or the operation pen 7 is in contact with the projection surface 2S based on the position data. The determination unit 75 generates determination data indicating contact or non-contact between the projection surface 2S and the operation pen 7 or the like. The determination unit 75 transmits the determination data to the drawing control unit 73.

[0043] The determination unit 75 determines the separation distance Dh at which the finger 5 or the operation pen 7 is separated from the projection surface 2S based on the position data. The determination unit 75 compares the separation distance Dh with a comparison value such as a predetermined detection distance dt1. The determination unit 75 determines whether the separation distance Dh is smaller than the comparison value. The determination unit 75 generates determination data, instructions, etc. indicating the determination result. The determination unit 75 transmits the determination data, instructions, etc. to the drawing control unit 73. The separation distance Dh and the detection distance dt1 are both distances in the +Z direction.

[0044] First embodiment The first embodiment shows an image display method for determining whether or not a finger 5 or an operation pen 7 is in contact with the projection surface 2S, and controlling the display of various images based on the determination result. The first embodiment shows an image display method when an operation pen 7 is used. The first embodiment shows an image display method executed by the projector 1 shown in FIG. 3. The projector 1 executes the same image display method when the user operates the projector 1 with a finger 5 instead of the operation pen 7. The image display method corresponds to an example of a display method.

[0045] FIG. 4 shows a projection image PG projected by the projector 1. FIG. 4 shows a projection image PG projected on the projection surface 2S when the projector 1 operates in the whiteboard mode. The whiteboard mode is a mode in which the projection screen 2 functions as an electronic whiteboard. The electronic whiteboard is a device capable of capturing an image written on the projection surface 2S as data. When the projector 1 is in the whiteboard mode, the user can use an interactive function that allows the user to draw objects, images, etc. on the whiteboard displayed on the projection surface 2S with a finger 5 or an operation pen 7. Note that the user may be able to use the interactive function when the projector 1 is in a mode other than the whiteboard mode. An example of a mode other than the whiteboard mode is an annotation mode. The annotation mode is a mode in which a content image is displayed on the projection surface 2S without displaying a whiteboard, and objects, images, etc. are drawn superimposed on the content image. The content image is an image based on image data shared by the projector 1 from a supply device (not shown). The supply device (not shown) is, for example, a personal computer, and the content image is, for example, a still image stored in the personal computer.

[0046] Fig. 4 shows the projected image PG when the operation pen 7 is not in contact with the projection surface 2S. The operation pen 7 shown in Fig. 4 is not in contact with the projection surface 2S. The operation pen 7 is held by the user at a position on the XY plane shown in Fig. 4 and at a first position P1 spaced apart from the projection surface 2S. The projected image PG has a drawing area DA and an operation area OA. The first position P1 indicates a position on the XY plane parallel to the projection surface 2S in the +Z direction of the projection surface 2S.

[0047] The drawing area DA is an area in which a drawing image DG can be drawn by a user's operation. The drawing area DA is configured with a plain background, for example. When the projector 1 receives captured data related to a drawing instruction operation, the drawing area DA displays a drawing image DG corresponding to the drawing instruction operation. In the drawing area DA shown in FIG. 4, an operation screen 110, an icon display area AD, etc. are displayed.

[0048] The operation screen 110 is displayed on the projection surface 2S when the operation pen 7 is not in contact with the projection surface 2S. The operation screen 110 is displayed in the vicinity of the operation pen 7. Details of the operation screen 110 will be described later.

[0049] The icon display area AD is an area for displaying one or more icons. The types and number of icons displayed in the icon display area AD are set as appropriate. The position of the icon display area AD is set in advance. The icon display area AD shown in FIG. 4 is disposed in a position in the -X direction and the -Y direction of the projection surface 2S, but is not limited to this. The position of the icon display area AD is set as appropriate.

[0050] The operation area OA is an area in which multiple icons are fixedly displayed. The operation area OA shown in Fig. 4 displays multiple icons including a color designation icon group 111. The operation area OA shown in Fig. 4 is disposed in a position in the -Y direction of the projection surface 2S, but is not limited to this. The operation area OA may be disposed in a position in the +Y direction of the projection surface 2S, etc.

[0051] FIG. 5 shows a schematic configuration of the operation screen 110. The operation screen 110 is a display image capable of accepting attribute settings of the drawn image DG. The attribute settings are settings related to the color, line width, line type, etc. of the drawn image DG. The operation screen 110 is operated by a user before the user draws the drawn image DG. The operation screen 110 shown in FIG. 5 displays a plurality of icons including a color designation icon group 111 and a line width designation icon group 113. The operation screen 110 includes icons related to attribute settings of the drawn image DG. The types and number of icons displayed on the operation screen 110 are set appropriately. The operation screen 110 corresponds to an example of an operation image.

[0052] The color designation icon group 111 is operated by the user when designating the color of the drawing image DG to be drawn in the drawing area DA. The color designation icon group 111 includes a plurality of icons of different colors. When the user performs a designation operation to designate a specific icon from among a plurality of icons included in the plurality of color designation icon groups 111, the projector 1 accepts the color of the icon for which the designation operation has been performed as the designated color.

[0053] The line width designation icon group 113 is operated by the user when designating the line width of the drawing image DG to be drawn in the drawing area DA. The line width designation icon group 113 includes a plurality of icons having different line widths. When the user performs a designation operation to designate a specific icon among a plurality of icons included in the plurality of line width designation icon groups 113, the projector 1 accepts the line width of the icon for which the designation operation has been performed as the designated line width.

[0054] FIG. 6 shows a projection image PG projected by the projector 1. FIG. 6 shows the projection image PG when the operation pen 7 is not in contact with the projection surface 2S. The operation pen 7 shown in FIG. 6 is not in contact with the projection surface 2S. FIG. 6 shows the projection image PG when the operation pen 7 is moved from a first position P1 to a second position P2 by the user. The second position P2 indicates a position on the XY plane parallel to the projection surface 2S in the +Z direction of the projection surface 2S. The operation pen 7 moves from the first position P1 to the second position P2 along the first locus T1 without contacting the projection surface 2S.

[0055] When the operation pen 7 moves from the first position P1 to the second position P2 with respect to the projection surface 2S without contacting the projection surface 2S, the operation screen 110 moves following the operation pen 7. The operation screen 110 moving following the operation pen 7 indicates that the operation screen 110 moves within a position within a predetermined distance range from the operation pen 7. When the drawing control unit 73 determines that the operation pen 7 is moving based on the position data, it moves the operation screen 110 following the movement of the operation pen 7. When the operation pen 7 moves without contacting the projection surface 2S, the drawing control unit 73 does not generate the drawing image DG. When the operation pen 7 moves without contacting the projection surface 2S, the projection image PG does not display the drawing image DG.

[0056] When the user stops the operation pen 7 at the second position P2, the drawing control unit 73 stops the movement of the operation screen 110. The drawing control unit 73 displays the operation screen 110 at a position within a predetermined range from the second position P2.

[0057] FIG. 7 shows a projection image PG projected by the projector 1. FIG. 7 shows the projection image PG when the operation pen 7 is in contact with the projection surface 2S. The operation pen 7 shown in FIG. 7 is in contact with the projection surface 2S at a third position P3. The third position P3 is a position different from the display position where the operation screen 110 is displayed. The third position P3 indicates a position on the projection surface 2S. The third position P3 is the drawing start position of the drawn image DG.

[0058] 7 shows a state in which the operation screen 110 is displayed within the projection image PG. When the operation pen 7 touches a position on the projection surface 2S that is different from the display position of the operation screen 110, the projector 1 may maintain the display of the operation screen 110, or may make the operation screen 110 non-display.

[0059] It is preferable that the projector 1 hides the operation screen 110 when the operation pen 7 comes into contact with a position on the projection surface 2S that is different from the display position of the operation screen 110. When the operation pen 7 comes into contact with a position different from the operation screen 110, the drawing control unit 73 hides the operation screen 110. When the operation screen 110 is hidden, it is possible to prevent the operation screen 110 from blocking a part of the drawing area DA when the user draws the drawing image DG.

[0060] The projector 1 may lower the display density of the operation screen 110 when the operation pen 7 comes into contact with a position on the projection surface 2S that is different from the display position of the operation screen 110. When the operation pen 7 comes into contact with a position different from the operation screen 110, the drawing control unit 73 lowers the display density of the operation screen 110. When the display density of the operation screen 110 is lowered, it is possible to prevent the operation screen 110 from blocking a part of the drawing area DA when the user draws the drawing image DG.

[0061] FIG. 8 shows a projection image PG projected by the projector 1. FIG. 8 shows the projection image PG when the operation pen 7 is in contact with the projection surface 2S. FIG. 8 shows the projection image PG when the operation pen 7 is moved from the third position P3 to the fourth position P4 by the user. The fourth position P4 indicates a position on the projection surface 2S. The operation pen 7 moves from the third position P3 to the fourth position P4 along the second locus T2 while in contact with the projection surface 2S. When the operation pen 7 moves from the third position P3 to the fourth position P4, a first drawn image DG1 is drawn on the projection surface 2S.

[0062] The first drawn image DG1 is drawn along the second locus T2. The first drawn image DG1 is an example of a drawn image DG. The first drawn image DG1 is a line image connecting the third position P3 and the fourth position P4. The first drawn image DG1 is drawn in accordance with a preset attribute setting. The user sets the attribute setting before drawing the first drawn image DG1.

[0063] While the operation pen 7 is in contact with the projection surface 2S and is moving from the third position P3 to the fourth position P4, the projector 1 may or may not display the operation screen 110. The drawing control unit 73 may lower the display density of the operation screen 110.

[0064] 8 shows a state in which the operation pen 7 is stopped at the fourth position P4. When the user stops the operation pen 7 at the fourth position P4, the drawing control unit 73 displays the operation screen 110. The drawing control unit 73 displays the operation screen 110 at a position within a predetermined range from the fourth position P4.

[0065] Fig. 9 shows a projection image PG projected by the projector 1. Fig. 9 shows the projection image PG when the operation pen 7 is in contact with the projection surface 2S. The operation pen 7 shown in Fig. 9 contacts the projection surface 2S at a display position where the operation screen 110 is displayed. When the operation pen 7 contacts the projection surface 2S at the display position of the operation screen 110, the user can perform an operation such as a designation operation on the operation screen 110.

[0066] When the operation pen 7 comes into contact with the display position of the operation screen 110, the projector 1 maintains the display of the operation screen 110 for a predetermined time after the contact. When the operation pen 7 is separated from the projection surface 2S within the predetermined time, the projector 1 does not hide the operation screen 110. For the predetermined time after the contact, the projector 1 does not change the display position of the operation screen 110. This makes it easier for the user to perform operations such as designation operations on the operation screen 110.

[0067] Fig. 10 shows the control flow of the projector 1. Fig. 10 shows, in a flowchart, an image display method that the projector 1 executes in response to the position of the operation pen 7. Fig. 10 shows the image display method that is performed by the projector 1 executing the control program CP.

[0068] In step S101, the projector 1 determines whether or not the operation pen 7 is in contact with the projection surface 2S. The image capturing unit 15 captures an area including the projection surface 2S at regular time intervals and generates image capturing data. The image capturing unit 15 transmits the image capturing data to the determination unit 75. The determination unit 75 generates position data based on the image capturing data. The determination unit 75 determines whether or not the operation pen 7 is in contact with the projection surface 2S based on the position data. When the determination unit 75 determines that the operation pen 7 is not in contact with the projection surface 2S, it generates non-contact determination data. The non-contact determination data is determination data indicating that the operation pen 7 is not in contact with the projection surface 2S. The projector 1 proceeds to step S103 (step S101: NO). When the determination unit 75 determines that the operation pen 7 is in contact with the projection surface 2S, it generates contact determination data. The contact determination data is determination data indicating that the operation pen 7 is in contact with the projection surface 2S. The projector 1 proceeds to step S111 (step S101: YES).

[0069] When the projector 1 determines that the operation pen 7 is not in contact with the projection surface 2S, the projector 1 displays the operation screen 110 in step S103. When the determination unit 75 generates non-contact determination data, the determination unit 75 transmits the non-contact determination data and the position data to the drawing control unit 73. The drawing control unit 73 receives the non-contact determination data and the position data. When the drawing control unit 73 receives the non-contact determination data, the drawing control unit 73 projects the operation screen 110 onto the projection surface 2S. The drawing control unit 73 controls the image generation device 40 to generate screen data for displaying the operation screen 110. The image projection device 30 projects the projection image PG including the operation screen 110 onto the projection surface 2S based on the screen data. The projector 1 displays the operation screen 110 on the projection surface 2S by projecting the projection image PG including the operation screen 110 onto the projection surface 2S.

[0070] The projector 1 determines a position at which the operation screen 110 is to be displayed based on the position data. The drawing control unit 73 determines a display position at which the operation screen 110 is to be displayed based on the position data. The drawing control unit 73 determines a position within a predetermined distance range with respect to the position on the XY plane of the operation pen 7 as the display position of the operation screen 110. The drawing control unit 73 displays the operation screen 110 at the determined display position.

[0071] After displaying the operation screen 110, the projector 1 determines whether or not the operation pen 7 is sliding in step S105. The determination unit 75 generates position data at predetermined time intervals based on the captured data. The determination unit 75 determines whether or not the operation pen 7 is sliding relative to the projection surface 2S in a state where it is not in contact with the projection surface 2S, based on the position data. The sliding movement indicates a movement on the XY plane.

[0072] If the projector 1 determines that the operation pen 7 is sliding, the process proceeds to step S107 (step S105: YES). If the projector 1 determines that the operation pen 7 is not sliding, the process returns to step S101 (step S105: NO).

[0073] When the projector 1 determines that the operation pen 7 is sliding, in step S107, it slides the operation screen 110. When the determination unit 75 determines that the operation pen 7 is sliding, it transmits position data to the drawing control unit 73. The drawing control unit 73 receives the position data. The drawing control unit 73 slides the operation screen 110 based on the position data. The drawing control unit 73 slides the operation screen 110 in accordance with the movement of the operation pen 7.

[0074] The drawing control unit 73 slides the operation screen 110 at a position a predetermined distance away from the operation pen 7. The predetermined distance is set in advance. As an example, the predetermined distance is a distance that is accessible by the user's hand. The drawing control unit 73 slides the operation screen 110 within an area that is a predetermined distance away from the operation pen 7 as the center.

[0075] When the operation pen 7 moves a predetermined distance, the drawing control unit 73 may slide the operation screen 110 by changing the display position of the operation screen 110 in the direction of movement of the operation pen 7. The drawing control unit 73 may slide the operation screen 110 by continuously changing the display position of the operation screen 110 along the path of movement of the operation pen 7. The display mode when the operation screen 110 moves can be set appropriately.

[0076] When the projector 1 determines that the operation pen 7 is in contact with the projection surface 2S, in step S111, it determines whether or not the contact position of the operation pen 7 is the display position of the operation screen 110. The operation pen 7 moves from a position not in contact with the projection surface 2S to a position in contact with the projection surface 2S by the user's operation. The determination unit 75 determines whether or not the operation pen 7 is in contact with the projection surface 2S at the display position of the operation screen 110 based on the position data.

[0077] When the determination unit 75 determines that the operation pen 7 is in contact with the projection surface 2S at the display position of the operation screen 110, the projector 1 proceeds to step S113 (step S111: YES). When the determination unit 75 determines that the operation pen 7 is in contact with the projection surface 2S at a position different from the display position of the operation screen 110, the projector 1 proceeds to step S115 (step S111: NO).

[0078] In step S113, the projector 1 accepts a designation operation by the user. The determination unit 75 determines the contact position of the operation pen 7 on the operation screen 110 based on the position data. The determination unit 75 identifies an icon corresponding to the contact position. The determination unit 75 identifies designation information associated with the identified icon. The determination unit 75 accepts a designation operation on the operation screen 110 by the user by identifying the designation information. The designation operation is an operation for designating attribute settings related to drawing associated with each of a plurality of icons displayed on the operation screen 110. The designation operation corresponds to an example of a setting operation.

[0079] In step S115, the projector 1 accepts an image generation operation by the user. The determination unit 75 determines the contact position of the operation pen 7 based on the position data. The determination unit 75 identifies the contact position as a drawing start position of the drawn image DG by the user. By identifying the drawing start position, the determination unit 75 accepts an image generation operation by the user on the operation screen 110. The image generation operation is an operation of drawing the drawn image DG on the projection surface 2S. The image generation operation corresponds to an example of a drawing operation.

[0080] When the operation pen 7 comes into contact with the projection surface 2S and then slides while in contact with the projection surface 2S, the determination unit 75 accepts the sliding movement of the operation pen 7 as an image generation operation. The determination unit 75 accepts the contact of the operation pen 7 at a position different from the display position of the operation screen 110, and the sliding movement of the operation pen 7 from the contact position, as an image generation operation.

[0081] The projector 1 may hide the operation screen 110 when receiving an image generation operation by the user. The determination unit 75 generates a hide instruction when the operation pen 7 comes into contact with a position different from the display position of the operation screen 110. The determination unit 75 may generate a hide instruction when the operation pen 7 comes into contact with a position different from the display position of the operation screen 110 and the operation pen 7 moves on the projection surface 2S in the contact state. The determination unit 75 transmits the hide instruction to the drawing control unit 73. The drawing control unit 73 receives the hide instruction.

[0082] The drawing control unit 73 transmits a non-display instruction to the image generating device 40. The image generating device 40 performs processing to hide the operation screen 110 based on the non-display instruction. The drawing control unit 73 changes the operation screen 110 to a non-display state based on the non-display instruction. When the user draws the drawing image DG, the projector 1 hides the operation screen 110. The projector 1 reduces the possibility that the operation screen 110 will interfere with the user's drawing.

[0083] The projector 1 may lower the display density of the operation screen 110 when receiving an image generation operation by the user. The determination unit 75 generates a display control instruction when the operation pen 7 contacts a position different from the display position of the operation screen 110. The determination unit 75 may generate a display control instruction when the operation pen 7 contacts a position different from the display position of the operation screen 110 and moves on the projection surface 2S in a contact state. The determination unit 75 transmits the display control instruction to the drawing control unit 73. The drawing control unit 73 receives the display control instruction.

[0084] The drawing control unit 73 transmits a display control instruction to the image generating device 40. The image generating device 40 performs processing to reduce the display density of the operation screen 110 based on the display control instruction. The drawing control unit 73 changes the display density of the operation screen 110 based on the display control instruction, and reduces the display density. When the user draws a drawing image DG, the projector 1 reduces the display density of the operation screen 110. The projector 1 reduces the possibility that the operation screen 110 will interfere with the user's drawing.

[0085] The image display method includes determining whether or not the operation pen 7 is in contact with the projection surface 2S on which the drawing image DG is displayed; determining a separation distance Dh from the operation pen 7 to the projection surface 2S when it is determined that the operation pen 7 is not in contact with the projection surface 2S; displaying an operation screen 110 on the projection surface 2S that can accept attribute settings of the drawing image DG drawn on the projection surface 2S by the operation pen 7 when it is determined that the operation pen 7 is in contact with the projection surface 2S, and accepting an image generation operation to draw the drawing image DG on the projection surface 2S or a designation operation on the operation screen 110 when it is determined that the operation pen 7 is in contact with the projection surface 2S. Before the user starts drawing, the projector 1 displays an operation screen 110 related to attribute settings of the drawn image DG. The user can recognize that it is possible to perform attribute settings related to the drawn image DG before starting drawing.

[0086] This includes determining whether or not the operation pen 7 is sliding relative to the projection surface 2S when it is determined that the operation pen 7 is not in contact with the projection surface 2S, and when it is determined that the operation pen 7 is sliding relative to the projection surface 2S, it is preferable to slide the operation screen 110 in accordance with the movement of the operation pen 7. Since the operation screen 110 slides and moves following the operation pen 7, the user can easily view the operation screen 110 when sliding the operation pen 7.

[0087] When it is determined that the operation pen 7 has contacted a position on the projection surface 2S different from the display position where the operation screen 110 is displayed, and the operation pen 7 has moved from the contact position, it is preferable to change the operation screen 110 to a hidden display. When the user draws the drawing image DG, the operation screen 110 is prevented from interfering with the user's drawing.

[0088] The projector 1 has one or more control processors 70. The one or more control processors 70 execute the following: determining whether or not the operation pen 7 is in contact with the projection surface 2S on which the drawn image DG is displayed, displaying on the projection surface 2S an operation screen 110 capable of accepting attribute settings of the drawn image DG to be drawn on the projection surface 2S when it is determined that the operation pen 7 is not in contact with the projection surface 2S, and accepting an image generating operation for drawing the drawn image DG on the projection surface 2S or a designation operation on the operation screen 110 when it is determined that the operation pen 7 is in contact with the projection surface 2S. Before the user starts drawing, the projector 1 displays an operation screen 110 related to attribute settings of the drawn image DG. The user can recognize that it is possible to perform attribute settings related to the drawn image DG before starting drawing.

[0089] Second embodiment The second embodiment shows an image display method for determining the distance between the finger 5 or operation pen 7 and the projection surface 2S, and controlling the display of various images based on the determination result. The second embodiment shows an image display method when the operation pen 7 is used. The second embodiment shows an image display method executed by the projector 1 shown in FIG. 3. The projector 1 executes the same image display method when the user operates the projector 1 with the finger 5 instead of the operation pen 7. The image display method corresponds to an example of a display method.

[0090] Fig. 11 shows the control flow of the projector 1. Fig. 11 shows, in a flowchart, an image display method that the projector 1 executes in response to the position of the operation pen 7. Fig. 11 shows the image display method that is performed by the projector 1 executing the control program CP.

[0091] 12A and 12B show the relationship between the operation pen 7 and the projection surface 2S. FIG. 12A and 12B show the operation pen 7 and the projection surface 2S as viewed from the +X direction. FIG. 12A and 12B show the separation distance Dh, the detection distance dt1, the set distance dt2, and the like shown in FIG. 11. The detection distance dt1 shown in FIG. 12A and 12B is the same as the detection distance dt1 shown in FIG. 2. FIG. 12A shows the relationship between the operation pen 7 and the projection surface 2S in which the separation distance Dh is the first separation distance Dh1. The first separation distance Dh1 is smaller than the detection distance dt1 and larger than the set distance dt2. FIG. 12B shows the relationship between the operation pen 7 and the projection surface 2S in which the separation distance Dh is the second separation distance Dh2. The second separation distance Dh2 is smaller than the set distance dt2. The separation distance Dh corresponds to an example of a distance. The separation distance Dh, the first separation distance Dh1, the second separation distance Dh2, the detection distance dt1, and the set distance dt2 are all distances in the +Z direction.

[0092] 13A and 13B show a projection image PG projected by the projector 1. FIG. 13A and 13B show a state in which the operation pen 7 is not in contact with the projection surface 2S. FIG. 13A and 13B show a schematic diagram of the slide movement distance Ms and the allowable distance mt shown in FIG. 11. FIG. 13A shows a state in which the slide movement distance Ms is the first slide movement distance Ms1. FIG. 13B shows a state in which the slide movement distance Ms is the second slide movement distance Ms2. The slide movement distance Ms, the allowable distance mt, the first slide movement distance Ms1, and the second slide movement distance Ms2 are all distances in a direction perpendicular to the +Z direction. The direction perpendicular to the +Z direction is an example of the second direction. The direction perpendicular to the +Z direction is a direction included in the XY plane, and is substantially parallel to the projection surface 2S.

[0093] The first slide movement distance Ms1 shown in FIG. 13A is the linear distance between the fifth position P5 and the sixth position P6 when the user slides the operation pen 7. The first slide movement distance Ms1 is greater than the allowable distance mt. The user moves the operation pen 7 without touching the projection surface 2S. The user may move the operation pen 7 from the fifth position P5 to the sixth position P6 in a linear manner or in a curved manner.

[0094] The second slide movement distance Ms2 shown in FIG. 13B is a linear distance between the fifth position P5 and the seventh position P7 when the user slides the operation pen 7. The second slide movement distance Ms2 is smaller than the allowable distance mt. The user moves the operation pen 7 without touching the projection surface 2S. The user may move the operation pen 7 linearly or curvedly from the fifth position P5 to the seventh position P7. The slide movement distance Ms including the first slide movement distance Ms1 and the second slide movement distance Ms2 corresponds to an example of a movement distance.

[0095] The allowable distance mt is set in advance and stored in the storage unit 60. As an example, the allowable distance mt is a distance that sets a range that includes at least a part of the display position of the operation screen 110. The allowable distance mt is set to a distance that allows the user to easily access the operation screen 110. The allowable distance mt corresponds to an example of a threshold value.

[0096] As shown in FIG. 11, the projector 1 determines whether the separation distance Dh is equal to or less than the detection distance dt1 in step S201. As shown in FIG. 12A and FIG. 12B, the separation distance Dh is the distance between the operation pen 7 and the projection surface 2S along the Z axis. The image capturing unit 15 captures an area including the projection surface 2S at regular time intervals and generates captured data. The image capturing unit 15 transmits the captured data to the determination unit 75. The determination unit 75 generates position data based on the captured data. The determination unit 75 calculates the separation distance Dh using the position data. The determination unit 75 reads out the detection distance dt1 from the storage unit 60. The storage unit 60 stores the detection distance dt1 in advance. The determination unit 75 compares the separation distance Dh with the detection distance dt1. The determination unit 75 determines whether the separation distance Dh is equal to or less than the detection distance dt1. The detection distance dt1 corresponds to an example of a first distance.

[0097] When the user brings the operation pen 7 closer to the projection surface 2S, the separation distance Dh becomes the first separation distance Dh1 as shown in FIG. 12A, for example. When the separation distance Dh is the first separation distance Dh1, the determination unit 75 determines that the separation distance Dh is equal to or shorter than the detection distance dt1. The projector 1 proceeds to step S203 (step S201: YES). The first separation distance Dh1 corresponds to an example of the second distance. When it is determined that the separation distance Dh is greater than the detection distance dt1, the projector 1 proceeds to step S205 (step S201: NO).

[0098] In step S203, the projector 1 displays the operation screen 110. When the determination unit 75 determines that the separation distance Dh is equal to or less than the detection distance dt1, the determination unit 75 generates a display instruction. The display instruction is a command that instructs displaying the operation screen 110. The determination unit 75 transmits the display instruction and position data to the drawing control unit 73. The drawing control unit 73 receives the display instruction and the position data. When the drawing control unit 73 receives the display instruction, the drawing control unit 73 projects the operation screen 110 onto the projection surface 2S. The drawing control unit 73 controls the image generation device 40 to generate screen data for displaying the operation screen 110. The image projection device 30 projects a projection image PG including the operation screen 110 onto the projection surface 2S based on the screen data. The projector 1 displays the operation screen 110 on the projection surface 2S by projecting the projection image PG including the operation screen 110 onto the projection surface 2S.

[0099] In step S205, the projector 1 hides the operation screen 110. When the determination unit 75 determines that the separation distance Dh is greater than the detection distance dt1, it does not generate a display instruction. When the drawing control unit 73 does not receive a display instruction, it does not display the operation screen 110. The drawing control unit 73 continues the operation screen 110 in the hidden state. When the operation pen 7 is located at a position farther away than the detection distance dt1, the operation screen 110 is not displayed. The projector 1 can suppress the execution of unnecessary image processing.

[0100] After displaying the operation screen 110, the projector 1 accepts a movement operation in step S207. When the user slides the operation pen 7 on the projection surface 2S, the determination unit 75 detects that the operation pen 7 has moved based on the position data. By detecting that the operation pen 7 has moved by sliding, the determination unit 75 accepts a movement operation by the user.

[0101] After receiving the movement operation, the projector 1 determines in step S209 whether the separation distance Dh is equal to or less than the set distance dt2. The set distance dt2 is a predetermined distance. The set distance dt2 is smaller than the detection distance dt1. The set distance dt2 is the distance between the second virtual plane VS2 and the projection surface 2S. The second virtual plane VS2 is a virtual plane that is in the +Z direction from the projection surface 2S and parallel to the projection surface 2S. The set distance dt2 is stored in advance in the memory unit 60. The determination unit 75 reads out the set distance dt2. The determination unit 75 compares the separation distance Dh with the set distance dt2.

[0102] When the separation distance Dh is, for example, the second separation distance Dh2 smaller than the first separation distance Dh1 as shown in FIG. 12B, the determination unit 75 determines that the separation distance Dh is equal to or smaller than the set distance dt2. The second separation distance Dh2 corresponds to an example of the third distance. The projector 1 proceeds to step S211 (step S209: YES). When the separation distance Dh is the first separation distance Dh1 as shown in FIG. 12A, the determination unit 75 determines that the separation distance Dh is larger than the set distance dt2. The projector 1 proceeds to step S213 (step S209: NO).

[0103] In step S211, the projector 1 judges whether the slide movement distance Ms is equal to or less than the allowable distance mt. The judgment unit 75 detects the slide movement distance Ms by which the operation pen 7 has slid based on the position data. The judgment unit 75 may detect the slide movement distance Ms by which the operation pen 7 has slid per unit time based on the position data. The judgment unit 75 compares the slide movement distance Ms with the allowable distance mt. When the slide movement distance Ms is the first slide movement distance Ms1 shown in FIG. 13A, the judgment unit 75 judges that the slide movement distance Ms is greater than the allowable distance mt. When the slide movement distance Ms is greater than the allowable distance mt, the projector 1 proceeds to step S213 (step S211: NO). When the slide movement distance Ms is the second slide movement distance Ms2 shown in FIG. 13B, the judgment unit 75 judges that the slide movement distance Ms is equal to or less than the allowable distance mt. When the slide movement distance Ms is equal to or less than the permissible distance mt, the projector 1 proceeds to step S215 (step S211: YES).

[0104] In step S213, the projector 1 moves the operation screen 110 in a following manner. When the determination unit 75 accepts the movement operation, it generates position data based on the shooting data. The determination unit 75 transmits the position data to the drawing control unit 73. The determination unit 75 also transmits a movement instruction to the drawing control unit 73. The movement instruction is an instruction to move the operation screen 110 in a following manner to the movement of the operation pen 7. The drawing control unit 73 receives the position data and the movement instruction. The drawing control unit 73 slides the operation screen 110 based on the position data. The drawing control unit 73 slides the operation screen 110 in a following manner to the movement of the operation pen 7. The drawing control unit 73 slides the operation screen 110 continuously or intermittently in a following manner to the movement of the operation pen 7.

[0105] In step S215, the projector 1 stops the operation screen 110. When the determination unit 75 receives the movement operation, it generates position data based on the shooting data. The determination unit 75 transmits the position data to the drawing control unit 73. The determination unit 75 also transmits a stop instruction to the drawing control unit 73. The stop instruction is an instruction to not move the operation screen 110 following the movement of the operation pen 7. The drawing control unit 73 receives the position data and the stop instruction. The drawing control unit 73 does not move the operation screen 110 following the sliding movement of the operation pen 7. The drawing control unit 73 displays the operation screen 110 on the projection surface 2S in a stopped state. When the sliding movement distance Ms of the operation pen 7 is smaller than the allowable distance mt, there is a possibility that the user performs a designation operation on the operation screen 110. By the projector 1 stopping the operation screen 110, the user can easily access the operation screen 110.

[0106] The image display method includes determining a separation distance Dh between the operation pen 7 and the projection surface 2S, and displaying an operation screen 110 on the projection surface 2S when it is determined that the separation distance Dh is a first separation distance Dh1 that is smaller than a predetermined detection distance dt1. Since the operation screen 110 moves following the movement of the operation pen 7, the user can easily access the operation screen 110 after moving the operation pen 7 by a large amount.

[0107] When it is determined that the separation distance Dh is the second separation distance Dh2 which is smaller than the first separation distance Dh1, it is preferable that when the sliding movement distance Ms of the operation pen 7 on the projection surface 2S is greater than the allowable distance mt, the operation screen 110 is moved in response to the movement of the operation pen 7, and when the sliding movement distance Ms is smaller than the allowable distance mt, the operation screen 110 is not moved in response to the sliding movement of the operation pen 7. The user can easily access the operation screen 110, and operability is improved.

[0108] Third embodiment The third embodiment shows a display mode of the operation screen 110. The third embodiment shows a display example when the operation screen 110 is displayed on the projection surface 2S on which the drawn image DG is displayed in advance. The display example of the operation screen 110 shown in the third embodiment can be diverted to the display mode of the operation screen 110 in the first and second embodiments.

[0109] 14 and 15 show a projection image PG projected by the projector 1. FIG. 14 and 15 show a state in which an operation screen 110 is displayed on the projection surface 2S on which a second drawn image DG2, which is an example of a drawn image DG, is displayed in advance. Although FIG. 14 and FIG. 15 show the second drawn image DG2, an image different from the second drawn image DG2 may be displayed. Instead of the second drawn image DG2, an image based on image data received from an external device may be displayed. The second drawn image DG2 corresponds to an example of a drawn object.

[0110] FIG. 14 shows the operation screen 110 when the operation pen 7 is located on the second drawn image DG2. The operation pen 7 is not in contact with the projection surface 2S. The operation screen 110 shown in FIG. 14 is displayed above the operation pen 7. There are non-drawing positions above, below, and to the left of the operation pen 7 where the second drawn image DG2 is not drawn. The non-drawing positions are areas where the second drawn image DG2 and the operation screen 110 do not overlap. In FIG. 14, the operation screen 110 is displayed above the second drawn image DG2, which is a part of the non-drawing positions. The operation screen 110 may be displayed to the left or below the second drawn image DG2. By displaying the operation screen 110 at the non-drawing positions, it is possible to suppress a decrease in visibility of the second drawn image DG2.

[0111] FIG. 15 shows the operation screen 110 when the operation pen 7 is located near the second drawn image DG2. The operation pen 7 is not in contact with the projection surface 2S. The operation screen 110 shown in FIG. 15 is displayed below the operation pen 7. Below and to the left of the operation pen 7, there is a non-drawing position where the second drawn image DG2 is not drawn. In FIG. 15, the operation screen 110 is displayed below the second drawn image DG2, which is a part of the non-drawing position. The operation screen 110 may be displayed to the left of the second drawn image DG2. By displaying the operation screen 110 at the non-drawing position, it is possible to suppress a decrease in visibility of the second drawn image DG2.

[0112] When the drawn second drawn image DG2 is displayed on the projection surface 2S, it is preferable to display the operation screen 110 at a non-drawing position that does not overlap with the second drawn image DG2. By displaying the operation screen 110 at a position where it does not overlap with the second drawn image DG2, it is possible to prevent the operation screen 110 from making the second drawn image DG2 difficult to view.

[0113] The following is a summary of this disclosure.

[0114] Appendix 1 The display method of the present disclosure includes determining whether or not an indicator is in contact with a display surface on which an object is displayed, determining a distance from the indicator to the display surface when it is determined that the indicator is not in contact with the display surface, determining a distance from the indicator to the display surface in a state in which the indicator is not in contact when it is determined that the indicator is not in contact with the display surface, displaying an operation image on the display surface that can accept attribute settings of the object to be drawn on the display surface by the indicator when it is determined that the indicator is in contact with the display surface, or accepting a drawing operation to draw the object on the display surface or a setting operation for the operation image. The projection device displays an operation image relating to attribute setting of an object before the user starts drawing, so that the user can recognize that attribute setting relating to the object is possible before starting drawing.

[0115] Appendix 2 A display method as described in Appendix 1, comprising determining whether or not the indicator is moving relative to the display surface when it is determined that the indicator is not in contact with the display surface, and when it is determined that the indicator is moving relative to the display surface, moving the operation image in accordance with the movement of the indicator. Since the operation image moves following the pointer, the user can easily visually recognize the operation image when moving the pointer.

[0116] Appendix 3 In the display method described in Appendix 2, when it is determined that the distance is a third distance smaller than the second distance, when the movement distance of the indicator on the display surface is greater than a threshold value, the operation image is moved in accordance with the movement of the indicator, and when the movement distance is smaller than the threshold value, the operation image is not moved in accordance with the movement of the indicator. The user can easily access the operation image, and operability is improved.

[0117] Appendix 4 A display method according to any one of Supplementary Notes 1 to 3, in which when it is determined that the indicator has come into contact with a position on the display surface different from a display position where the operation image is displayed and the indicator has moved from that position, the operation image is changed to not displayed. When the user draws an object, the operation image is prevented from interfering with the user's drawing.

[0118] Appendix 5 In the display method according to any one of Supplementary Note 1 to Supplementary Note 4, when a drawn object is to be displayed on the display surface, the operation image is displayed at a non-drawing position that does not overlap with the drawn object. By displaying the operation image at a position where it does not overlap with the already-drawn object, it is possible to prevent the operation image from making the already-drawn object difficult to see.

[0119] Appendix 6 The projection device of the present disclosure is a projection device having one or more processors, which determine whether or not a pointer is in contact with a display surface on which an object is displayed, and, if it is determined that the pointer is not in contact with the display surface, display on the display surface an operation image capable of accepting attribute settings of the object to be drawn on the display surface, and, if it is determined that the pointer is in contact with the display surface, accept a drawing operation to draw the object on the display surface or a setting operation for the operation image. The projection device displays an operation image relating to attribute setting of an object before the user starts drawing, so that the user can recognize that attribute setting relating to the object is possible before starting drawing. [Explanation of symbols]

[0120] 1...projector, 2...projection screen, 2S...projection surface, 5...finger, 7...operation pen, 11...remote control light receiving unit, 13...signal light transmitting unit, 15...capturing unit, 17...remote control, 20...wireless communication unit, 30...image projection device, 31...light source, 33...light modulation device, 35...optical unit, 40...image generating device, 41...image processing unit, 43...OSD synthesis unit, 45...frame memory, 50...control device, 60...storage unit, 70...control processor, 71...communication control unit, 73...drawing control unit, 75...determination unit, 100...projection system, 110...operation screen, 111...color designation icon group, 113...line width designation icon group, AD...icon display area, CP...control program, DA...drawing area, DG...drawing image, DG1...first drawing image, DG2...second drawing image, Dh...separation distance, Dh1...first separation distance, Dh2...second separation distance, dt1...detection distance, dt2...set distance, LA...detection area, LT...detection light, Ms...slide movement distance, Ms1...first slide movement distance, Ms2...second slide movement distance, mt...allowable distance, OA...operation area, P1...first position, P2...second position, P3...third position, P4...fourth position, P5...fifth position, P6...sixth position, P7...seventh position, PG...projected image, VS1...first virtual surface, VS2...second virtual surface, T1...first trajectory, T2...second trajectory.

Claims

1. determining whether or not a pointer is in contact with a display surface on which an object is to be displayed; when it is determined that the indicator is not in contact with the display surface, determining a distance from the indicator to the display surface in a state in which the indicator is not in contact; If it is determined that the distance is a second distance that is smaller than the predetermined first distance, displaying, on the display surface, an operation image capable of accepting attribute setting of the object drawn on the display surface by the pointer; accepting a drawing operation for drawing the object on the display surface or a setting operation for the operation image when it is determined that the pointer is in contact with the display surface; Display methods including.

2. determining whether or not the indicator is moving relative to the display surface when it is determined that the indicator is not in contact with the display surface; when it is determined that the indicator is moving relative to the display surface, the operation image is moved in accordance with the movement of the indicator. The display method according to claim 1 .

3. If it is determined that the distance is a third distance which is smaller than the second distance, When a moving distance of the indicator on the display surface is greater than a threshold value, the operation image is moved in accordance with the movement of the indicator; When the movement distance is smaller than the threshold value, the operation image is not moved in accordance with the movement of the indicator. The display method according to claim 2.

4. when it is determined that the indicator has come into contact with a position on the display surface that is different from a display position where the operation image is displayed and that the indicator has moved from the position, the operation image is changed to a non-display state; The display method according to claim 1 .

5. When a drawn object is displayed on the display surface, the operation image is displayed at a non-drawing position that does not overlap with the drawn object. The display method according to claim 1 .

6. 1. A projection device having one or more processors, comprising: The one or more processors: determining whether or not a pointer is in contact with a display surface on which an object is to be displayed; when it is determined that the indicator is not in contact with the display surface, displaying, on the display surface, an operation image capable of accepting attribute setting of the object drawn on the display surface; accepting a drawing operation for drawing the object on the display surface or a setting operation for the operation image when it is determined that the pointer is in contact with the display surface; Execute the Projection device.

Images