Image display method and projector

Abstract

To allow a user to easily perform association between a marker and an image when utilizing a technique of displaying the image by using the marker.SOLUTION: An image display method comprises the steps of: displaying a first image based on first image data output from a first input source on a display surface; detecting that a first marker is installed in a detection area included in a detection surface; and associating a feature of the first marker with the first input source when it is detected that the first marker is installed in the detection area in a case where the first image is displayed on the display surface.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an image display method and a projector. [Background technology]

[0002] Conventionally, there is known a technology in which a projector determines the position where an image is to be displayed according to the position of a marker detected on a display surface. In the configuration disclosed in Patent Document 1, when a user places a marker according to the position where the user wants to display an image, the image associated with the marker is displayed at the position corresponding to the marker. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-92337 Summary of the Invention [Problem to be solved by the invention]

[0004] In the configuration described in Patent Document 1, it is necessary to associate the marker with the image in advance, and there has been a demand for a way to make this task easier. [Means for solving the problem]

[0005] One aspect of the present disclosure is an image display method that includes displaying a first image based on first image data output from a first input source on a display surface, detecting that a first marker has been placed in a detection area included in a detection surface, and, when it is detected that the first marker has been placed in the detection area while the first image is being displayed on the display surface, associating characteristics of the first marker with the first input source.

[0006] One aspect of the present disclosure is a projector that includes a projection device including a light source, a modulation device that emits image light by modulating the light emitted by the light source, and a projection optical system that projects the image light onto a display surface; an imaging device that images a detection area included in a detection surface and outputs imaging data; and a processor, wherein the processor projects a first image based on first image data input from a first input source using the projection device, detects that a first marker has been placed in the detection area based on the imaging data, and, when it detects that the first marker has been placed in the detection area while projecting the first image, associates characteristics of the first marker with the first input source. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a configuration diagram of a projection system. [Figure 2] Projector block diagram. [Figure 3] FIG. 4 is an explanatory diagram of a first operation mode of the projector. [Figure 4] 10 is a flowchart showing the operation of the projector. [Figure 5] 10 is a flowchart showing the operation of the projector. [Figure 6] FIG. 10 is an explanatory diagram of a second operation mode of the projector. [Figure 7] 10 is a flowchart showing the operation of the projector. [Figure 8] FIG. 10 is an explanatory diagram of a third operation mode of the projector. [Figure 9] FIG. 10 is an explanatory diagram of a fourth operation mode of the projector. [Figure 10] FIG. 10 is an explanatory diagram of a fifth operation mode of the projector. DETAILED DESCRIPTION OF THE INVENTION

[0008] [1. Projection system overview] FIG. 1 is a perspective view of a projection system 100 according to an embodiment of the present invention. The projection system 100 includes a projector 1. The projector 1 corresponds to an example of a display device. The projector 1 projects image light PL onto a screen SC serving as a display surface, thereby displaying an image on the screen SC.

[0009] The screen SC may be, for example, a flat surface such as a wall surface or a hanging curtain, and may be any surface that can form an image by reflecting the image light PL emitted by the projector 1. For example, a blackboard or whiteboard on which writing can be done may be used as the screen SC.

[0010] The projector 1 forms a projection image on the screen SC by projecting image light PL onto the screen SC. The area onto which the projector 1 can project the image light PL is referred to as the projection area PA. The projection area PA can be said to be the displayable area onto which the projector 1 can display an image. In the normal use state of the projector 1, the projection area PA is projected so as to fit within the screen SC. The image projected by the projector 1 may be either a still image or a video. Video refers to a so-called moving image. In the following description, the image projected by the projector 1 is referred to as the projected image, and the projected image may be either a still image or a video.

[0011] The projector 1 has a function of detecting markers 61 placed on a detection surface. The detection surface may be the same surface as the screen SC, which is the display surface, or a different surface. Furthermore, the detection surface may be a surface set at a different position from the screen SC on the same surface as the display surface. In this embodiment, an example is shown in which the detection surface is a surface common to the screen SC, that is, an example in which the screen SC is the detection surface. Furthermore, the range in which the projector 1 detects the markers 61 is defined as a detection surface DA. The detection surface DA and the projection area PA may or may not overlap. In this embodiment, the detection surface DA includes the projection area PA. The detection surface DA may coincide with the projection area PA, but in this embodiment, the detection surface DA is wider than the projection area PA.

[0012] There is no limit to the number of markers 61 that can be used in the projection system 100. In the following description, markers 61A, 61B, and 61C are shown. When there is no need to distinguish between these, they will be referred to as markers 61.

[0013] The marker 61 may be any object on the detection surface as long as it is optically distinguishable from other portions of the screen SC. The marker 61 may be an independently movable object or a pattern or shape formed on the screen SC. For example, the marker 61 is an object attached or attached to the screen SC. The marker 61 may be attached using an adhesive substance, a suction cup, or magnetic attraction. For example, the marker 61 may be a pattern, letter, figure, or the like drawn on the detection surface DA of the screen SC. The marker 61 may also be a pattern, letter, figure, or the like formed by means other than attachment, placement, or drawing. The marker 61 can be removed, removed, or erased from the screen SC by a user. For example, the marker 61 can be moved by hand and fixed at any position on the screen SC. The marker 61A shown in FIG. 1 is a disk-shaped object.

[0014] The projector 1 can detect the characteristics of the marker 61. The characteristics of the marker 61 refer to optically identifiable attributes. Optically identifiable attributes are not limited to attributes that can be detected and identified using visible light, but also include attributes that can be detected and identified using infrared light or ultraviolet light. For example, the characteristics of the marker 61 are the external color, pattern, and shape.

[0015] [2. Projector configuration] The projector 1 includes a projection device 20. The projection device 20 includes a light source 21, a modulation device 22, and an optical unit 23. A light source drive circuit 24 and a modulation device drive circuit 25, which operate under the control of the control unit 10, are connected to the projection device 20. The projection device 20 corresponds to an example of a display unit. The optical unit 23 corresponds to an example of a projection optical system.

[0016] The light source 21 is configured with a solid-state light source such as an LED or laser light source. The light source 21 may also be a lamp such as a halogen lamp, a xenon lamp, or an ultra-high pressure mercury lamp. The light source 21 emits light when driven by a light source drive circuit 24. The projector 1 may also include a drive circuit that supplies power to the light source 21 under the control of the control unit 10.

[0017] The modulator 22 modulates the light emitted by the light source 21 to generate image light PL and irradiates the optical unit 23 with the image light PL. The modulator 22 includes light modulation elements such as a transmissive liquid crystal light valve, a reflective liquid crystal light valve, or a digital mirror device. The light modulation elements of the modulator 22 are connected to a modulator drive circuit 25. The modulator drive circuit 25 drives the light modulation elements of the modulator 22 to sequentially form the light modulation elements of the modulator 22 line by line, ultimately forming an image frame by frame. The modulator 22 may also include a drive circuit for driving the light modulation elements. For example, if the modulator 22 is configured with a liquid crystal light valve, a liquid crystal driver circuit may be included as the drive circuit.

[0018] The optical unit 23 includes optical elements such as lenses and mirrors, and forms an image from the image light PL on the screen SC, thereby displaying a projected image on the screen SC.

[0019] The projector 1 includes a control unit 10, an image capturing device 30, an interface 41, an image processing circuit 42, a frame memory 43, an input processing circuit 45, a remote control light receiving unit 46, and an operation panel 47.

[0020] The control unit 10 includes a processor 11 and a memory 15. The processor 11 may be configured as a single processor or multiple processors. The processor 11 may be configured as a SoC (System on Chip) integrated with part or all of the memory 15 and / or other circuits. As described above, the processor 11 may be configured as a combination of a CPU (Central Processing Unit) that executes programs and a DSP (Digital Signal Processor) that executes predetermined arithmetic processing. All of the functions of the processor 11 may be implemented in hardware or may be configured using a programmable device. The processor 11 may also have the functions of the image processing circuit 42. In other words, the functions of the image processing circuit 42 may be executed by the processor 11.

[0021] The memory 15 is a storage device that nonvolatilely stores programs and data executed by the processor 11. The memory 15 is configured by a magnetic storage device, a semiconductor storage element such as a flash ROM (Read Only Memory), or other types of nonvolatile storage device.

[0022] The memory 15 may include a RAM (Random Access Memory) that constitutes a work area for the processor 11. The memory 15 stores data processed by the control unit 10 and control programs executed by the processor 11. The memory 15 stores, for example, a control program 16, setting data 17, correspondence data 18, and photographic data D.

[0023] The control program 16 is a program executed by the processor 11. The data 17 includes data that is set in advance regarding the functions and operations of the projector 1. The correspondence data 18 corresponds to the characteristics of the marker 61 and the input source selected by the projector 1. Dealing with Data is.

[0024] The photographing device 30 is a so-called digital camera, and performs photographing under the control of the control unit 10, and outputs photographed data D. The photographing range, that is, the angle of view, of the photographing device 30 includes the detection plane DA.

[0025] The photographing device 30 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. The photographing device 30 includes a data processing circuit that generates photographic data D based on the light reception state of the image sensor. The photographing device 30 may be configured to capture images using visible light, or may capture images using light with wavelengths outside the visible range, such as infrared light or ultraviolet light.

[0026] There are no limitations on the specific format of the shooting data D. For example, the shooting data D may be RAW data, or image data in JPEG (Joint Photographic Experts Group) format, or image data in PNG (Portable Network Graphics) format or other formats. The photographing device 30 takes color photographs and outputs the shooting data D of the color images.

[0027] The interface 41 is an interface through which image data is input, and includes a connector to which a transmission cable (not shown) is connected, and an interface circuit that receives image data via the transmission cable. For example, the interface 41 includes an HDMI (High-Definition Multimedia Interface) interface. The HDMI interface includes a connector to which an HDMI cable is connected, and an interface circuit that receives image data in the transmission format of the HDMI standard. Also, for example, the interface 41 includes an analog interface. The analog interface includes a D-sub connector and a D-sub interface circuit. The D-sub interface circuit includes an analog / digital conversion circuit. HDMI is a registered trademark.

[0028] Furthermore, for example, the interface 41 may include a USB (Universal Serial Bus) interface. The USB interface includes a USB connector and a USB interface circuit. Furthermore, for example, the interface 41 may include a LAN (Local Area Network) interface. The LAN interface includes an Ethernet connector and a LAN interface circuit that performs data communication in a transmission format conforming to the TCP / IP standard. Ethernet is a registered trademark. Without being limited to these examples, the interface 41 may include a connector and an interface circuit that can transmit various types of data, including image data. Furthermore, the interface 41 may include a wireless communication device and be configured to receive image data via a wireless communication line.

[0029] A plurality of input sources 2 can be connected to the interface 41. An input source 2 refers to a device that outputs image data to the projector 1. While FIG. 2 shows an example in which three input sources 2A, 2B, and 2C are connected to the interface 41, there is no limit to the number of input sources 2 that can be connected to the interface 41.

[0030] The input source 2 is, for example, a notebook PC (Personal Computer), a desktop PC, a tablet terminal, a smartphone, or a PDA (Personal Digital Assistant). The input source 2 may also be a video playback device, a DVD (Digital Versatile Disk) player, a Blu-ray Disc player, or the like. The input source 2 may also be a hard disk recorder, a television tuner device, a CATV (Cable television) set-top box, a video game console, or the like.

[0031] The input sources 2A, 2B, and 2C are connected to different connectors of the interface 41 or wireless communication lines, respectively. In this embodiment, the input source 2A is connected to the HDMI interface, the input source 2B is connected to the USB interface, and the input source 2C is connected to the LAN interface.

[0032] Under the control of the control unit 10, the projector 1 projects an image using the projection device 20 based on image data input to the interface 41. The projector 1 has a function of selecting a predetermined number of pieces of image data from the image data input to the interface 41. In this case, the projector 1 selects the input sources 2A, 2B, and 2C by selecting the interface or wireless communication line to which the input sources 2A, 2B, and 2C are connected in the interface 41. For example, when selecting image data input from the input source 2C, the projector 1 selects the LAN interface of the interface 41. In this way, the projector 1 selects an interface included in the interface 41 when selecting image data to be displayed on the screen SC.

[0033] The projector 1 may select the input sources 2A, 2B, and 2C of the interface 41 based on more detailed information, rather than simply specifying the input sources 2A, 2B, and 2C based on the interface, connector, or communication line. For example, the control unit 10 may designate a LAN interface of the interface 41 as one input source 2. The control unit 10 may also designate a network address in the LAN connected to the interface 41 as one input source 2. A computer name or a device name may be used instead of a network address.

[0034] The image processing circuit 42 can be configured, for example, by an integrated circuit. The integrated circuit is configured, for example, by an LSI (Large Scale Integration). More specifically, the image processing circuit 42 is configured by an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or the like. The PLD includes, for example, an FPGA (Field-Programmable Gate Array). Furthermore, an analog circuit may be included as part of the configuration of the integrated circuit, or the integrated circuit may be a combination of a processor and an integrated circuit. The combination of a processor and an integrated circuit is called a microcontroller (MCU), SoC, system LSI, chipset, or the like.

[0035] A frame memory 43 may be connected to the image processing circuit 42. The frame memory 43 is configured, for example, by an SDRAM (Synchronous Dynamic Random Access Memory). In this case, the image processing circuit 42 loads the image data input from the interface 41 into the frame memory 43. The image processing circuit 42 executes image processing on the image data loaded into the frame memory 43. Examples of image processing that the image processing circuit 42 can execute include resolution conversion processing, geometric correction processing, digital zoom processing, and image correction processing that adjusts the color tone and brightness of an image.

[0036] The image processing circuit 42 performs various processes including geometric correction processing for correcting trapezoidal distortion of a projected image, OSD (On Screen Display) processing for superimposing an OSD image, and image adjustment processing for adjusting brightness and color.

[0037] The image processing circuit generates an image signal based on the image data after image processing. The modulation device 22 generates image light PL based on the image signal generated by the image processing circuit .

[0038] The input processing circuit 45 receives input to the projector 1. The input processing circuit 45 is connected to a remote control light receiving unit 46 that receives an infrared signal transmitted by a remote control (not shown), and an operation panel 47 provided on the main body of the projector 1.

[0039] The remote control light receiving unit 46 receives an infrared signal transmitted from a remote control (not shown). The remote control light receiving unit 46 decodes the received infrared signal to generate an operation signal. The remote control light receiving unit 46 outputs the generated operation signal to the input processing circuit 45.

[0040] The configuration in which the remote control and the remote control light receiving unit 46 transmit and receive infrared signals is one example. For example, the remote control and the remote control light receiving unit 46 may transmit and receive operation signals by performing short-range wireless communication such as Bluetooth. Bluetooth is a registered trademark.

[0041] The operation panel 47 includes various buttons and switches provided on the surface of the housing of the projector 1. The operation panel 47 generates operation signals corresponding to the operation of the buttons and switches, and outputs the operation signals to the input processing circuit 45.

[0042] The input processing circuit 45 detects an operation by the remote control by decoding a signal received by the remote control light receiving unit 46. The input processing circuit 45 also detects an operation on the operation panel 47. The input processing circuit 45 outputs data indicating the operation content to the control unit 10.

[0043] The processor 11 executes a control program 16 stored in the memory 15 to function as a projection control unit 12, a detection unit 13, and a processing unit .

[0044] The projection control unit 12 controls the image processing circuit 42, the light source drive circuit 24, and the modulation device drive circuit 25 to cause the projection device 20 to project the image light PL.

[0045] The detection unit 13 detects the marker 61. The detection unit 13 causes the photographing device 30 to perform photographing, and temporarily stores the photographed data D output by the photographing device 30 in the memory 15. The detection unit 13 extracts an image of the marker 61 from the photographed data D. For example, the detection unit 13 extracts the image of the marker 61 by performing image processing such as boundary detection and pattern matching on the photographed data D.

[0046] The detection unit 13 detects the characteristics of the marker 61 based on the extracted image of the marker 61. The characteristics of the marker 61 are optically identifiable attributes, as described above.

[0047] The detection unit 13 identifies the position of the marker 61 on the detection plane DA based on the shooting data D. The position of the marker 61 is represented by XY coordinates set on the detection plane DA, for example, as shown in Fig. 3, which will be described later. Here, the detection unit 13 may represent the position of the marker 61 by coordinates in the projection area PA.

[0048] The detection unit 13 is capable of detecting the marker 61 over the entire detection surface DA. The detection unit 13 also sets an instruction area 81 and a setting area 82 as specific areas in which the marker 61 is to be detected.

[0049] The instruction area 81 and the setting area 82 are areas set within the detection surface DA, and are, for example, rectangular areas. The positions and sizes of the instruction area 81 and the setting area 82 are specified, for example, by the setting data 17. The shapes, positions, and sizes of the instruction area 81 and the setting area 82 can be changed arbitrarily. The setting area 82 corresponds to an example of a detection area.

[0050] When the detection unit 13 detects that the marker 61 is present on the detection surface DA, it determines whether the position of the detected marker 61 is in the instruction area 81 and whether it is in the setting area 82. Here, the detection unit 13 may be configured to detect whether the marker 61 is present in the instruction area 81. Similarly, the detection unit 13 may be configured to determine whether the marker 61 is present in the setting area 82.

[0051] The detection unit 13 may cause the projection device 20 to display an image showing either or both of the instruction area 81 and the setting area 82. For example, the detection unit 13 causes the projection device 20 to display a frame showing the boundary between the instruction area 81 and an area other than the instruction area 81. Also, for example, the detection unit 13 causes the projection device 20 to display a frame showing the boundary between the setting area 82 and an area other than the setting area 82. The detection unit 13 displays the images of these frames, for example, on an OSD. Specific aspects of the instruction area 81 and the setting area 82 will be described later.

[0052] The processing unit 14 operates the projector 1 based on the features of the marker 61 detected by the detection unit 13 and the position of the marker 61.

[0053] In detail, when the detection unit 13 detects the marker 61 and the position of the marker 61 is within the setting area 82, the processing unit 14 performs a process of associating the characteristics of the marker 61 with the input source 2. In this case, the processing unit 14 generates information indicating the association between the characteristics of the marker 61 and the input source 2, and stores the information in the memory 15 as association data 18.

[0054] Furthermore, when the detection unit 13 detects a marker 61 and the position of the marker 61 is within the designation area 81, the processing unit 14 refers to the correspondence data 18. Based on the correspondence data 18, the processing unit 14 identifies the input source 2 that is associated with the characteristics of the detected marker 61. The processing unit 14 causes the projection control unit 12 to select the identified input source 2. The projection control unit 12 selects the input source 2 of the interface 41. The projection control unit 12 causes the projection device 20 to display an image based on the selected input source 2.

[0055] These functions of the detection unit 13 and the processing unit 14 allow the user to easily perform the operation of associating the input source 2 with the marker 61. The user operates a remote control or operation panel 47 (not shown) to cause the projector 1 to select the input source 2 that the user wishes to associate with the marker 61. When the user places the marker 61 in the setting area 82 while the projector 1 is displaying an image based on the input source 2 selected by the user, the characteristics of the marker 61 placed by the user are associated with the input source 2 being displayed. If the user has access to multiple markers 61 with different characteristics, the user can associate each of these multiple markers 61 with a different input source 2.

[0056] For example, if marker 61A is the first marker, the correspondence data 18 associates the characteristics of marker 61A with input source 2, which is the first input source. As a result, marker 61A is associated with projected image 71A based on the first image data output from input source 2, which is the first input source. Similarly, if marker 61B is the second marker, the correspondence data 18 associates the characteristics of marker 61B with input source 2, which is the second input source. As a result, marker 61B is associated with projected image 71B based on the second image data output from input source 2, which is the second input source.

[0057] Thereafter, the user can place a marker 61 in the setting area 82 to select an input source 2 associated with the characteristics of the placed marker 61. Therefore, the user can display an image based on the desired input source 2 with an easier operation than operating the remote control or operation panel 47.

[0058] The setting states of the instruction area 81 and the setting area 82 on the detection surface DA and the corresponding operation of the projector 1 are called the operation mode of the projector 1. There are multiple operation modes of the projector 1. Below, the five operation modes of the projector 1 will be explained in order.

[0059] The correspondence data 18 may be erased each time the projector 1 is turned off, or may be reset each time the projector 1 is turned on. Also, for example, the storage area in the memory 15 where the correspondence data 18 is stored may be a volatile storage area. In this case, the correspondence data 18 is initialized each time the projector 1 is turned on / off. Therefore, for example, in a projector 1 used by multiple users, each user can comfortably use the projector 1 without being affected by the settings made by other users. Also, a configuration may be adopted in which names are assigned to the correspondence data 18 according to a preset naming rule, and multiple pieces of correspondence data 18 are stored in the memory 15 in a non-volatile manner.

[0060] [3. First operation mode of the projector] FIG. 3 is an explanatory diagram of the first operation mode of the projector 1. As shown in FIG. In the first operation mode, one instruction area 81 and one setting area 82 are set on the detection plane DA. The positions of the instruction area 81 and the setting area 82 may be inside or outside the projection area PA.

[0061] 3, one projection image 71 is displayed in the projection area PA, and a designation area 81 and a setting area 82 are set in an area overlapping the projection image 71. Also, a marker 61A is placed in the designation area 81. In this example, the marker 61A corresponds to the first marker.

[0062] FIG. 4 is a flowchart showing the operation of the projector 1. The operation shown in FIG. 4 is started, for example, when the projector 1 is powered on and no marker 61 is placed on the detection surface DA.

[0063] In step S11, the detection unit 13 attempts to detect the marker 61 on the detection surface DA. In step S12, the detection unit 13 determines whether or not there is a marker 61. If it is determined that there is no marker 61 (step S12; NO), the detection unit 13 returns to step S11 and attempts to detect the marker 61 at a preset cycle.

[0064] If it is determined that the marker 61 is present (step S1 2 ;YES), the detection unit 13 In step S13, the detection unit 13 detects the characteristics of the marker 61. do.

[0065] In step S14, the processing unit 14 refers to the correspondence data 18 based on the characteristics of the marker 61 detected by the detection unit 13 in step S13. Then, the processing unit 14 determines whether the marker 61 detected by the detection unit 13 is a marker 61 that has already been set in the correspondence data 18.

[0066] If it is determined that the marker 61 is a set marker (step S14; YES), the processing unit 14 proceeds to step S15. In step S15, the processing unit 14 causes the projection device 20 to display an instruction guide image indicating the instruction area 81. The instruction guide image is an image that indicates the position and size of the instruction area 81, and is, for example, an image of the frame of the instruction area 81 shown in FIG. 3. The color and frame thickness of the instruction guide image are arbitrary, but it is desirable that the instruction guide image be visually distinguishable from the image being displayed by the projector 1 in the projection area PA and the background color of the screen SC. In step S15, the processing unit 14 causes the image processing circuit 42 to execute OSD processing, for example, to generate the instruction guide image.

[0067] After the instruction guide image is displayed, in step S16, the detection unit 13 determines whether the position of the marker 61 is inside the instruction area 81 indicated by the instruction guide image. In step S16, for example, if the marker 61 overlaps the frame of the instruction area 81, the detection unit 13 determines that the marker 61 is inside the instruction area 81. The same applies to a setting area 82, which will be described later.

[0068] If it is determined that the position of the marker 61 is not inside the instruction area 81 (step S16; NO), the detection unit 13 returns to step S11. If it is determined that the position of the marker 61 is inside the instruction area 81 (step S16; YES), the detection unit 13 proceeds to step S17. In step S17, the processing unit 14 causes the projection device 20 to display an image of the input source 2 associated with the marker 61 by the association data 18. That is, the processing unit 14 causes the interface 41 to select the input source 2 associated with the marker 61, and causes the projection device 20 to display an image based on the selected input source 2.

[0069] On the other hand, in step S14, if it is determined that the feature of the marker 61 detected in step S13 is not set to be associated with the input source 2 (step S14; NO), the detection unit 13 proceeds to step S18.

[0070] In step S18, the processing unit 14 determines whether or not an image is being displayed in the projection area PA by the projection device 20. If it is determined that an image is not being displayed in the projection area PA (step S18; NO), the processing unit 14 proceeds to step S19. In step S19, the processing unit 14 notifies the user that there is no input source 2 by, for example, displaying a message indicating that there is no input source.

[0071] The notification method performed by the control unit 10 is, for example, a method of displaying a message using an OSD. In this case, the processing unit 14 may stop the display of the image displayed in the projection area PA and display the entire projection area PA in black or a predetermined monochrome color. The notification method may also be, for example, a method of notification by sound or by blinking the projected image 71 being displayed.

[0072] If it is determined in step S18 that an image is being displayed in the projection area PA (step S18; YES), the processing unit 14 proceeds to step S20. In step S20, the processing unit 14 causes the projection device 20 to display a setting guide image indicating the setting area 82. The setting guide image is an image that indicates the position and size of the setting area 82, and is, for example, an image of the frame of the setting area 82 shown in FIG. 3. The color and frame thickness of the setting guide image are arbitrary, but it is desirable that the setting guide image be visually distinguishable from the image being displayed by the projector 1 in the projection area PA and the background color of the screen SC. In step S20, the processing unit 14 causes the image processing circuit 42 to execute OSD processing, for example, to generate the setting guide image. The setting guide image corresponds to an example of a detection guide image.

[0073] After the setting guide image is displayed, in step S21, the detection unit 13 detects the marker 6 The position of 1 is shown in the setting guide image. setting area 8 2 Determine whether it is inside the

[0074] If it is determined that the position of the marker 61 is not inside the setting area 82 (step S21; NO), the detection unit 13 returns to step S11. If it is determined that the position of the marker 61 is inside the setting area 82 (step S21; YES), the detection unit 13 proceeds to step S22. In step S22, the processing unit 14 performs a process of associating the input source 2 of the image being displayed in the projection area PA with the characteristics of the marker 61. In step S22, the processing unit 14 generates or updates the correspondence data 18 based on the result of the association process. Thereafter, in step S23, the processing unit 14 notifies that the association has been successful. In step S23, the processing unit 14 notifies by, for example, causing the image processing circuit 42 to execute OSD processing and displaying an image indicating that the association has been successful.

[0075] In step S17, if image data is not input to the interface 41 from the input source 2 associated with the marker 61 by the association data 18, the processing unit 14 may notify that no image data has been input. In step S17, the processing unit 14 may issue a notification that an image associated with the marker 61 will be displayed. The notification by the processing unit 14 may be issued before the image associated with the marker 61 is displayed.

[0076] Furthermore, when it is determined in step S16 that the marker 61 is inside the instruction area 81 (step S16; YES), the detection unit 13 may issue a notification before proceeding to step S17.

[0077] The detection unit 13 also detects the pointing area 81. instructions The guide image is displayed as a marker in step S11. The detection unit 13 may display the setting guide 82 before detecting the setting area 82. The image may be displayed before the marker 61 is detected in step S11.

[0078] 5 is a flowchart showing the operation of the projector 1. In detail, the operation of the projector 1 after the marker 61 is placed in the instruction area 81 and the image display is started in step S17 is shown.

[0079] While the image is being displayed, in step S31, the detection unit 13 If it is determined that there is no marker 61 in the designated area 81 ( Step S3 2 If NO, the detection unit 13 proceeds to step S33. The processing unit 14 notifies the user that the marker 61 is not present. The processing unit 14 stops the display of the image by the projection device 20. The instruction guide image is displayed by the projection device 20, and the process ends.

[0080] If the detection unit 13 determines that a marker is present in the instruction area 81 (step S32; YES), the process proceeds to step S36. In step S36, the processing unit 14 determines whether the marker 61 detected by the detection unit 13 is a marker 61 having a feature associated with the input source 2 of the image being displayed.

[0081] When the processing unit 14 determines that the detected marker 61 is the marker 61 associated with the input source 2 of the image being displayed (step S36; YES), the processing unit 14 returns to step S31.

[0082] If the processing unit 14 determines that the detected marker 61 is not the marker 61 having the characteristic associated with the input source 2 of the image being displayed (step S36; NO), the processing unit 14 proceeds to step S37. In step S37, the processing unit 14 causes the projection device 20 to display an image associated with the characteristic of the marker 61 detected by the detection unit 13 in step S31. More specifically, in step S37, the processing unit 14 causes the selection of the input source 2 associated with the characteristic of the marker 61 detected by the detection unit 13 in step S31. The processing unit 14 causes the projection device 20 to display an image based on the selected input source 2. As a result, in step S37, the projection image 71 being displayed in the projection area PA is switched to the projection image 71 associated with the marker 61.

[0083] [4. Second operation mode of the projector] FIG. 6 is an explanatory diagram of the second operation mode of the projector 1. As shown in FIG. In the second operation mode, one instruction area 81, one setting area 82, and one confirmation area 83 are set on the detection plane DA. The positions and sizes of the instruction area 81 and the setting area 82 are the same as in the first operation mode. The confirmation area 83 may be inside or outside the projection area PA. One projected image 71 is displayed in the projection area PA. The confirmation area 83 corresponds to an example of an auxiliary detection area.

[0084] The confirmation area 83 is an area used to confirm when the marker 61 is placed in the instruction area 81 and when the marker 61 is placed in the setting area 82.

[0085] In the first operation mode, the processing unit 14 performs processing when a marker 61 is placed in the instruction area 81 and when a marker 61 is placed in the setting area 82. In contrast, in the second operation mode, when a marker 61 having the same characteristics is placed in the instruction area 81 and the confirmation area 83, the processing unit 14 performs processing corresponding to the placement of the marker 61 in the instruction area 81.

[0086] For example, in the example of FIG. 6, the instruction area 81 to Marker 61A is installed in the confirmation area 83. A marker 61A having the same characteristics as the marker 61A in the indication area 81 is placed. Here, the marker 61A in the instruction area 81 corresponds to an example of the first marker, and the marker in the confirmation area 83 corresponds to an example of the first marker. The marker 61A corresponds to an example of a second marker. In this case, the processing unit 14 The process corresponding to the placement of the marker 61A is performed.

[0087] In addition, in the second operation mode, when a marker 61 having the same characteristics is placed in the setting area 82 and the confirmation area 83, the processing unit 14 performs processing corresponding to the placement of the marker 61 in the setting area 82.

[0088] 7 is a flowchart showing the operation of the projector 1 in the second operation mode. In the operation of FIG. 7, the same processing steps as those in FIG. 5 are assigned the same step numbers, and the description thereof will be omitted.

[0089] In the second operation mode, steps S41 and S42 are performed instead of steps S15 and S16 in the first operation mode shown in FIG.

[0090] In step S41, the processing unit 14 causes the projection device 20 to display an instruction guide image indicating the instruction area 81 and a confirmation image indicating the confirmation area 83, and then proceeds to step S42. The confirmation image is an image that indicates the position and size of the confirmation area 83, and is, for example, an image of the frame of the confirmation area 83 shown in FIG. 6. The color and frame thickness of the confirmation image are arbitrary, but it is desirable that the confirmation image be visually distinguishable from the image being displayed by the projector 1 in the projection area PA and the background color of the screen SC. In step S41, the processing unit 14 causes the image processing circuit 42 to perform OSD processing, for example, to generate the confirmation image.

[0091] In step S42, the detection unit 13 detects a mark having the same characteristics in the instruction area 81 and the confirmation area 83. It is determined whether or not there is a mark 61 in the indication area 81 and the confirmation area 83. If it is determined that there is no leader 61 (step S4 2 ; NO), the detection unit 13 proceeds to step S1 Return to 1.

[0092] If it is determined that the marker 61 having the same characteristics exists in the instruction area 81 and the confirmation area 83 ( Step S4 2 YES), the detection unit 13 proceeds to step S17.

[0093] In the second operation mode, steps S43 and S44 are performed instead of steps S20 and S21 in the first operation mode shown in FIG.

[0094] In step S43, the processing unit 14 causes the projection device 20 to display a setting guide image and a confirmation image, and then the process proceeds to step S44.

[0095] In step S44, the detection unit 13 determines whether or not there is a marker 61 having the same characteristics in the setting area 82 and the confirmation area 83. If it is determined that there is no marker 61 having the same characteristics in the setting area 82 and the confirmation area 83 (step S44; NO), the detection unit 13 returns to step S11.

[0096] If it is determined that the setting area 82 and the confirmation area 83 contain markers 61 having the same characteristics (step S44; YES), the detection unit 13 proceeds to step S22.

[0097] In the second operation mode, the processing unit 14 performs processing on the condition that markers 61 having the same characteristics are placed in the instruction area 81 and the confirmation area 83, or that markers 61 having the same characteristics are placed in the setting area 82 and the confirmation area 83. This prevents the processing unit 14 from performing matching or selecting the input source 2 due to erroneous detection of the marker 61. Specific examples of erroneous detection include a user mistakenly placing the marker 61 in the instruction area 81 or the setting area 82, or detecting a foreign object with a shape similar to the marker 61 in the instruction area 81 or the setting area 82. Therefore, executing the second operation mode has the advantage of suppressing operations based on erroneous detection.

[0098] [5. Third operation mode of the projector] FIG. 8 is an explanatory diagram of the third operation mode of the projector 1. As shown in FIG. The projector 1 has a display mode that displays multiple images in the projection area PA. For example, as shown in Fig. 8, the projector 1 can execute a dual-screen display mode that displays two projected images 71A and 71B side by side in the projection area PA. The projected images 71A and 71B are images based on different input sources 2. The projector 1 may also be capable of executing a quadruple-screen display mode that displays four images side by side in the projection area PA.

[0099] The third operation mode is an operation mode in which, in the dual-screen display mode or the quadruple-screen display mode, a designation area 81 and a setting area 82 are used. In the example of Fig. 8, the designation area 81 and the setting area 82 are arranged on the detection surface DA.

[0100] In the third operating mode, the projector 1 displays a projection image 71A based on the input source 2 associated with the marker 61A placed in the instruction area 81. This operation is similar to the operation described with reference to FIGS.

[0101] Furthermore, in the third operation mode, when the marker 61B is placed in the instruction area 81 together with the marker 61A, the projector 1 displays the projection image 71B based on the input source 2 associated with the marker 61B.

[0102] In this way, when the projector 1 detects that multiple markers 61A, 61B have been placed in the instruction area 81 while executing a display mode capable of displaying multiple projection images 71A, 71B in the projection area PA, the projector 1 displays the multiple projection images 71A, 71B. The projection images 71A, 71B displayed by the projector 1 are images based on the input sources 2 associated with the characteristics of the markers 61A, 61B placed in the instruction area 81. Furthermore, for example, while executing a display mode capable of displaying four images, the projector 1 can display four images based on the input sources 2 associated with the four markers 61.

[0103] While the third operation mode is being executed, the projector 1 may increase or decrease the number of images displayed in the projection area PA in accordance with the number of markers 61 placed in the instruction area 81. For example, when the marker 61B is no longer detected in the instruction area 81 in the state shown in Fig. 8, the processing unit 14 may stop displaying the projection image 71B and switch to a state in which only the projection image 71A is displayed in the projection area PA. In this case, the processing unit 14 may display only the projection image 71A in the entire projection area PA, as shown in Fig. 3, for example.

[0104] Furthermore, when it is detected that a marker 61 has been placed in the setting area 82 while the third operation mode is being executed, the processing unit 14 associates the marker 61 with the input source 2. In this case, the processing unit 14 performs processing to associate the input source 2 of either the projection image 71A or 71B with the marker 61 placed in the setting area 82.

[0105] The candidates for the input source 2 that the processing unit 14 associates with the marker 61 are either the input source 2 corresponding to the projection image 71A or the input source 2 corresponding to the projection image 71B. The processing unit 14 may allow the user to select the input source 2 to associate with the marker 61. Furthermore, the processing unit 14 may associate the input source 2 of one of the projection images 71A and 71B that is not associated with the marker 61 placed in the instruction area 81 with the marker 61 placed in the setting area 82. Furthermore, the processing unit 14 may associate the image of the projection images 71A and 71B that was displayed later in the projection area PA with the marker 61 placed in the setting area 82.

[0106] [6. Projector's fourth operating mode] FIG. 9 is an explanatory diagram of the fourth operation mode of the projector 1. As shown in FIG. Like the third operating mode, the fourth operating mode corresponds to a display mode in which the projector 1 displays multiple images. Fig. 9 shows a dual-screen display mode in which the projector 1 displays two projection images 71A and 71B side by side in the projection area PA.

[0107] In the fourth operating mode, the detection unit 13 provides a designation area 81A and a setting area 82A corresponding to the projected image 71A, and a designation area 81B and a setting area 82B corresponding to the projected image 71B. The designation area 81A corresponds to an example of a first designation area, and the designation area 81B corresponds to an example of a second designation area. The projected image 71A corresponds to an example of a first image, and the projected image 71B corresponds to an example of a second image.

[0108] During execution of the fourth operation mode, if the detection unit 13 detects that a marker 61A has been placed in the instruction area 81A, the processing unit 14 displays a projection image 71A based on an input source 2 associated with the characteristics of the marker 61A. During execution of the fourth operation mode, if the detection unit 13 detects that a marker 61B has been placed in the instruction area 81B, the processing unit 14 displays a projection image 71B based on an input source 2 associated with the characteristics of the marker 61B.

[0109] During execution of the fourth operation mode, if the detection unit 13 detects that a marker 61A has been placed in the setting area 82A, the processing unit 14 associates the input source 2 corresponding to the projection image 71A with the characteristics of the marker 61A. During execution of the fourth operation mode, if the detection unit 13 detects that a marker 61B has been placed in the setting area 82B, the processing unit 14 associates the input source 2 corresponding to the projection image 71B with the characteristics of the marker 61B.

[0110] In the fourth operating mode, the detection unit 13 may display that the instruction area 81A and the setting area 82A are areas corresponding to the projected image 71A, and that the instruction area 81B and the setting area 82B are areas corresponding to the projected image 71B.

[0111] [7. Fifth Projector Operation Mode] FIG. 10 is an explanatory diagram of the fifth operation mode of the projector 1. As shown in FIG. In the fifth operation mode, as shown in FIG. 10, one instruction area 81 and one setting area 82 are arranged in accordance with the overall state of the projection area PA.

[0112] When the processing unit 14 detects that the marker 61C has been placed in the setting area 82, the processing unit 14 performs a process of associating the marker 61C with the overall state of the projection area PA. In this case, the processing unit 14 associates the input source 2 corresponding to the projection image 71A, the input source 2 corresponding to the projection image 71B, and the display positions of the projection images 71A and 71B with the characteristics of the marker 61C. Unlike the first to fourth operation modes, the correspondence data 18 is information that associates the characteristics of the marker 61C with the input source 2 corresponding to the projection image 71A, the input source 2 corresponding to the projection image 71B, and the display positions of the projection images 71A and 71B.

[0113] The processing unit 14 detects by the detection unit 13 that the marker 61C has been placed in the indication area 81. When the marker 61C is detected, the processing unit 14 refers to the corresponding data 18 based on the characteristics of the marker 61C. selects two input sources 2 according to the corresponding data 18, as the first input source input A projection image 71A based on source 2 and a projection image 71B based on input source 2 as the second input source. The image 71B is displayed at the position designated by the correspondence data 18.

[0114] In this way, the projector 1 is not limited to the example of associating the characteristics of the marker 61 with one input source 2, but can also associate the overall state of the projection area PA. The overall state of the projection area PA includes at least the input sources 2 of all the projection images 71 displayed in the projection area PA. Furthermore, when multiple projection images 71 are displayed in the projection area PA, the relative positional relationship between each of the projection images 71 may also be included. The number of projection images 71 displayed in the projection area PA may also be included.

[0115] The projector 1 only needs to be able to execute at least one of the first to fifth operation modes.

[0116] Furthermore, the projector 1 may be able to switch between multiple of the first to fifth operation modes. In this case, there is no limit to the combination of operation modes that the projector 1 can execute. In this case, the operation mode may be switched in response to a user's operation of the remote control or operation panel 47, or may be automatically switched by the projector 1. For example, when the display mode of the projector 1 is switched to a display mode that displays multiple projection images 71, the operation mode related to the marker 61 may be automatically switched to the third, fourth, or fifth operation mode.

[0117] The projector 1 may be able to execute a combination of two or more of the first to fifth operation modes. For example, in the first operation mode, the projector 1 executes a process of associating the characteristics of the marker 61 with the input source 2 to generate the correspondence data 18. Using this correspondence data 18, the projected image 71 of the input source 2 corresponding to the marker 61 can be displayed in the second to fourth operation modes. The combination of operation modes and the execution order are arbitrary.

[0118] 8. Operation of the embodiment As described above, the image display method executed by the projector 1 includes displaying the projection image 71A based on image data output from the input source 2 on the screen SC. It also includes detecting that the marker 61 has been placed in the setting area 82 included in the detection plane DA. It also includes associating the characteristics of the first marker with the first input source when it is detected that the first marker has been placed in the setting area 82 while the first image is being displayed on the screen SC. For example, it includes displaying the projection image 71A as the first image based on image data output from the input source 2A as the first input source on the screen SC, and detecting that the marker 61A as the first marker has been placed in the setting area 82. It also includes associating the characteristics of the marker 61A with the input source 2A when it is detected that the marker 61A has been placed in the setting area 82 while the projection image 71A is being displayed on the screen SC.

[0119] According to the image display method of the projector 1, by placing the marker 61 in the setting area 82, the characteristics of the marker 61 are associated with the input source 2. This allows the user to easily associate the marker 61 with the input source 2.

[0120] In the above display method, the setting area 82 may include at least a part of the screen SC. In this case, the projector 1 detects that the marker 61 has been placed on the screen SC on which the image is displayed and executes processing. This allows the user to associate the marker 61 with the input source 2 without moving away from the screen SC.

[0121] The display method includes displaying on the screen SC a setting guide image indicating the setting area 82. This allows the user to easily place the marker 61 in an appropriate location. This makes it easier for the user to associate the marker 61 with the input source 2.

[0122] The display method may include, after associating the feature of the marker 61 with the input source, displaying a message indicating that the association has been successful. For example, after associating the feature of the marker 61A as the first marker with the input source 2A as the first input source, displaying a message indicating that the association has been successful. In this case, the user can be notified that the association between the marker 61 and the input source 2 has been successful.

[0123] The above display method is such that the marker 61 is placed in the indication area 81 included in the detection surface DA. and detecting a feature of the marker 61 detected in the indication area 81. An image based on the image data output from the input source 2 is displayed on the screen SC. For example, the first pointing area includes instructions area 8 1 Marker 61A was placed on and detecting the presence of the marker 61A and outputting the signal from the input source 2A associated with the characteristic of the marker 61A. and displaying a projected image 71A based on the first image data on a screen SC. This allows the user to place the marker 61 in the instruction area 81. The user can display a desired image on the screen SC.

[0124] The above display method includes stopping the display of the projected image 71 when the marker 61 is not detected in the instruction area 81 while the projected image 71 is being displayed on the screen SC. For example, when the projected image 71A is being displayed on the screen SC, stopping the display of the projected image 71A when the marker 61A is not detected in the instruction area 81. Therefore, the user can stop the display of the projected image 71 by removing the marker 61 from the instruction area 81.

[0125] The above display method may include stopping the display of the image and displaying an instruction guide image indicating the instruction area 81 when a marker 61 is not detected in the instruction area 81 while a projection image 71 is being displayed on the screen SC. For example, when a projection image 71A is being displayed on the screen SC and a marker 61A is not detected in the instruction area 81, the display of the projection image 71A is stopped and an instruction guide image indicating the instruction area 81 is displayed. In this case, it becomes easier for the user to perform an operation to display a new image on the screen SC.

[0126] In the above display method, the screen SC includes a first display area and a second display area for displaying an image, and a designation area 81B serving as a second designation area corresponding to the second display area. When a marker 61A is detected in the designation area 81A serving as the first designation area, the display method includes displaying, in the first display area, a projection image 71A based on an input source 2A associated with the characteristics of the marker 61A. When a marker 61A is detected in the designation area 81B, the display method also includes displaying, in the second display area, a projection image 71A based on an input source 2A associated with the characteristics of the marker 61A. In this way, when the screen SC has multiple display areas for displaying a projection image 71, the marker 61 can be used to display a projection image 71 based on image data of a user-desired input source 2 in the desired display area.

[0127] The display method further includes displaying a projection image 71B based on second image data output from an input source 2 serving as a second input source in a second display area included in the screen SC. When detecting that a marker 61 serving as a first marker has been placed in the instruction area 81, the display method includes associating the relative positions of the projection image 71A serving as the first image and the projection image 71B serving as the second image, the first input source 2, and the second input source 2 with the characteristics of the marker 61. This makes it possible to associate the entire display state in which multiple images are displayed on the screen SC with the characteristics of the marker 61. Therefore, by placing the marker 61 in the instruction area 81, the user can reproduce the display state of the entire screen SC.

[0128] The display method includes detecting that a first marker, 61A, has been placed in a designation area 81, which is a first designation area. The display method also includes displaying, on the screen SC, a projected image 71A based on first image data output from an input source 2 serving as a first input source, and a projected image 71B based on second image data output from an input source 2 serving as a second input source, which are associated with the first marker, 61A, in the designation area 81, in accordance with the relative positions associated with the marker 61A. This allows the entire display state of a plurality of images displayed on the screen SC to be associated with the characteristics of the marker 61. Therefore, by placing the marker 61 in the designation area 81, the user can reproduce the display state of the entire screen SC.

[0129] The display method includes detecting that a first marker 61A has been placed in the setting area 82, and, when detecting that a second marker 61A having the same characteristics as the marker 61A has been placed in a confirmation area 83 included in the detection plane DA, associating the characteristics of the marker 61A with the input source 2. This prevents the setting from being changed due to an erroneous operation or erroneous detection, such as when the user erroneously places the marker 61 in the setting area 82. Furthermore, by the user placing the marker 61A in the setting area 82 and the confirmation area 83, the association between the marker 61A and the input source 2 can be easily set.

[0130] The display method includes detecting that a marker 61A serving as a first marker has been placed in the instruction area 81, and detecting that a marker 61A serving as a second marker having the same characteristics as the marker 61A has been placed in a confirmation area 83 included in the detection plane DA, and then displaying on the screen SC a projection image 71A based on first image data output from an input source 2 associated with the characteristics of the marker 61A. This prevents a change in the display due to an erroneous operation or erroneous detection, such as when the user mistakenly places the marker 61 in the instruction area 81. Furthermore, by the user placing the marker 61A in the instruction area 81 and the confirmation area 83, an image based on the image data output from the input source 2 associated with the marker 61A can be easily displayed.

[0131] The display method includes, when it is detected that a first marker 61A has been placed in the instruction area 81, determining whether or not the characteristics of the marker 61A are associated with the input source 2. The display method includes, when it is determined that the characteristics of the marker 61A are associated with the input source 2, displaying a projection image 71A on the screen SC based on image data output from the input source 2 associated with the characteristics of the marker 61A. The display method includes, when it is determined that the characteristics of the marker 61A are not associated with the input source 2, associating the characteristics of the marker 61A with the input source 2. In this way, the projection image 71 is displayed or set depending on whether or not the marker 61 placed by the user in the instruction area 81 has already been set. Therefore, simply by the user placing the marker 61, processing corresponding to the characteristics of the marker 61 is performed, further reducing the workload on the user.

[0132] The projector 1 includes a light source 21 and modulates the light emitted by the light source 21 to generate image light. a modulator 22 that emits PL, and an optical unit 2 that projects the image light PL onto a screen SC. The projector 1 includes a projection device 20 including a detection surface DA. The image capturing device 30 captures an image of the area 82 and outputs the captured image data, and the processor 11. Projector 1 is Settings area 82 a detection unit 13 that detects that a marker has been placed on the , and a processing unit 14. The processor 11 receives the first input source from the projection device 20. a projection image as a first image based on first image data input from an input source 2 as a first image; The processor 11 projects the instruction area 71A based on the photographing data of the photographing device 30. When it is detected that the marker 61A has been placed in the area 81 and the projection image 71A is being projected When it is detected that the marker 61A is set in the setting area 82, the marker 61A The characteristics of the input source 2 are associated with each other.

[0133] According to the projector 1, by placing the marker 61 in the setting area 82, the characteristics of the marker 61 are associated with the input source 2 corresponding to the currently displayed projection image 71. This allows the user to easily associate the marker 61 with the input source 2.

[0134] 9. Other Embodiments above Memorial The embodiment shows a specific example to which the present invention is applied, and the present invention is not limited thereto. It is not something that can be done.

[0135] For example, in the above embodiment, a configuration has been described in which the interface 41 selects the input source 2 under the control of the control unit 10, but the method of selecting the input source 2 is not limited to this. For example, the memory 15 may store image data, and an image based on this image data may be displayed by the projection device 20. In this case, the projector 1 uses the image data from the memory 15 as one input source 2.

[0136] In the above embodiment, an example has been described in which the projector 1 optically detects the marker 61, but this is just one example. For example, the projector 1 may be configured to detect the marker 61 on the detection surface DA by wireless communication. For example, the marker 61 may be configured as a Bluetooth beacon or an RFID tag, and the projector 1 may perform detection by receiving a wireless signal from the marker 61.

[0137] In the above embodiment, a configuration has been described in which the projector 1 is used as an example of a display device. For example, a liquid crystal monitor or a liquid crystal television that displays an image on a liquid crystal display panel may be used as the display device. Furthermore, the display device may be an OLED (organic light-emitting diode) or OEL (organic electroluminescence) display, or may be a device that uses another display method.

[0138] Furthermore, each functional unit shown in FIG. 2 indicates a functional configuration and does not limit the specific implementation form. In the projector 1, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to configure the projector 1 so that the functions of multiple functional units are realized by a single processor executing a program. Furthermore, some of the functions realized by software in each of the above embodiments may be realized by hardware, or some of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of each of the other units of the projection system 100 may also be changed as desired without departing from the spirit of the invention.

[0139] Furthermore, for example, the step units of the operation shown in FIGS. 4, 5, and 7 are divided according to the main processing content to facilitate understanding of the operation of the projector 1, and the present disclosure is not limited by the way in which the processing units are divided or the names thereof. The operation may be divided into many step units according to the processing content. Furthermore, one step unit may be divided so as to include many processes. Furthermore, the order of the steps may be changed as appropriate within the scope that does not impede the spirit of the present disclosure. [Explanation of symbols]

[0140] 1...projector, 2, 2A, 2B, 2C...input source, 10...control unit, 11...processor, 12...projection control unit, 13...detection unit, 14...processing unit, 15...memory, 16...control program, 17...setting data, 18...corresponding data, 20...projection device, 21...light source, 22...modulation device, 23...optical unit (projection optical system), 24...light source driving circuit, 25...modulation device driving circuit, 30...image capture device, 41...interface, 42...image processing processing circuit, 43...frame memory, 45...input processing circuit, 46...remote control receiver, 47...operation panel, 61, 61A, 61B, 61C...markers, 71, 71A, 71B...projected image, 81, 81A, 81B...instruction area, 82, 82A, 82B...setting area (detection area), 83...confirmation area (auxiliary detection area), 100...projection system, D...shooting data, DA...detection surface, PA...projection area, PL...image light, SC...screen (display surface).

Claims

1. displaying a first image based on first image data output from a first input source on a display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; executing a process of associating a feature of the first marker with the first input source when it is detected that the first marker has been placed in the detection area while the first image is being displayed on a display surface; An image display method, including:

2. The image display method according to claim 1 , wherein the detection area includes at least a portion of the display surface.

3. The image display method according to claim 2 , further comprising displaying a detection guide image indicating the detection region on the display surface.

4. 4. The image display method according to claim 1, further comprising: after associating the feature of the first marker with the first input source, displaying a message indicating that the association has been successful.

5. Detecting that the first marker has been placed in a first indication area included in the detection surface; and displaying the first image based on the first image data output from the first input source associated with the feature of the first marker on the display surface.

6. 6. The image display method according to claim 5, wherein the first designation area is an area that does not overlap with the detection area.

7. 7. The image display method according to claim 5, further comprising stopping the display of the first image when the first marker is not detected in the first indication area while the first image is being displayed on the display surface.

8. 8. An image display method according to claim 5, further comprising: stopping the display of the first image and displaying an instruction guide image indicating the first instruction area when the first marker is not detected in the first instruction area while the first image is being displayed on the display surface.

9. The display surface includes a first display area and a second display area. a second indication area corresponding to the second display area, When the first marker is detected in the first indication area, displaying the first image based on the first image data output from the first input source associated with a feature of the first marker in the first display area; 9. An image display method according to claim 5, further comprising: when the first marker is detected in the second indication area, displaying the first image based on the first image data output from the first input source associated with a characteristic of the first marker in the second display area.

10. further comprising displaying a second image based on second image data output from a second input source in a second display area included in the display surface; 5. The image display method according to claim 1, further comprising: when detecting that the first marker has been placed in the detection area, updating first information associated with the characteristics of the first marker to second information associated with the relative position between the first image and the second image, the first input source, and the second input source, with the characteristics of the first marker.

11. Detecting that the first marker has been placed in a first indication area included in the detection surface; 11. The image display method of claim 10, further comprising: displaying, on the display surface, the first image based on the first image data output from the first input source associated with the first marker in the first indication area, and the second image based on the second image data output from the second input source, in accordance with the relative positions associated with the first markers.

12. An image display method described in any one of claims 1 to 11, wherein when it is detected that the first marker has been placed in the detection area, performing a process of matching the characteristics of the first marker with the first input source means performing a process of matching the characteristics of the first marker with the first input source when it is detected that the first marker has been placed in the detection area and when it is detected that a second marker having the same characteristics as the characteristics of the first marker has been placed in an auxiliary detection area included in the detection surface.

13. 12. An image display method according to claim 5, 6, 7, 8, 9, and 11, comprising: when detecting that the first marker has been placed in the first indication area and detecting that a second marker having the same characteristics as the characteristics of the first marker has been placed in an auxiliary detection area included in the detection surface, displaying on the display surface the first image based on the first image data output from the first input source associated with the characteristics of the first marker.

14. determining whether or not a feature of the first marker is associated with the first input source when it is detected that the first marker has been placed in the first pointing area; When it is determined that the feature of the first marker is associated with the first input source, displaying the first image based on the first image data output from the first input source associated with the feature of the first marker on the display surface; 12. The image display method according to claim 5, further comprising: associating the feature of the first marker with the first input source when it is determined that the feature of the first marker is not associated with the first input source.

15. displaying a first image based on first image data output from a first input source on a display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; when detecting that the first marker is placed in the detection area while the first image is being displayed on a display surface, associating a feature of the first marker with the first input source; after associating the feature of the first marker with the first input source, displaying an indication that the association was successful; An image display method, including:

16. An image display method as described in Claim 15, wherein the detection area includes at least a portion of the display surface.

17. An image display method as described in claim 16, comprising displaying a detection guide image indicating the detection area on the display surface.

18. Detecting that the first marker has been placed in a first indication area included in the detection surface; and displaying the first image based on the first image data output from the first input source associated with the feature of the first marker on the display surface.

19. The image display method described in Claim 18, characterized in that the first indication area is an area that does not overlap with the detection area.

20. The display surface includes a first display area and a second display area, a second indication area corresponding to the second display area, When the first marker is detected in the first indication area, displaying the first image based on the first image data output from the first input source associated with a feature of the first marker in the first display area; 20. An image display method according to claim 18 or claim 19, comprising, when the first marker is detected in the second indication area, displaying in the second display area the first image based on the first image data output from the first input source associated with the characteristics of the first marker.

21. displaying a first image based on first image data output from a first input source on a display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; when detecting that the first marker is placed in the detection area while the first image is being displayed on a display surface, associating a feature of the first marker with the first input source; Detecting that the first marker has been placed in a first indication area included in the detection surface; displaying the first image based on the first image data output from the first input source associated with the feature of the first marker on the display surface; stopping the display of the first image when the first marker is not detected in the first indication area while the first image is being displayed on the display surface; An image display method, including:

22. The image display method of claim 21, wherein the detection area includes at least a portion of the display surface.

23. An image display method as described in claim 22, comprising displaying a detection guide image indicating the detection area on the display surface.

24. The image display method according to claim 21, wherein the first indication area is an area that does not overlap with the detection area.

25. The display surface includes a first display area and a second display area, a second indication area corresponding to the second display area, When the first marker is detected in the first indication area, displaying the first image based on the first image data output from the first input source associated with a feature of the first marker in the first display area; 25. An image display method according to claim 21 or claim 24, comprising, when the first marker is detected in the second indication area, displaying in the second display area the first image based on the first image data output from the first input source associated with a characteristic of the first marker.

26. Displaying a first image based on first image data output from a first input source in a first display area included in a display surface; displaying a second image based on second image data output from a second input source in a second display area included in the display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; When detecting that the first marker is placed in the detection area, associating the relative position between the first image and the second image, the first input source, and the second input source with characteristics of the first marker; An image display method, including:

27. ​​An image display method as described in Claim 26, wherein the detection area includes at least a portion of the display surface.

28. An image display method as described in claim 27, comprising displaying a detection guide image indicating the detection area on the display surface.

29. displaying a first image based on first image data output from a first input source on a display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; Detecting that a second marker having the same characteristics as the first marker is placed in an auxiliary detection area included in the detection surface; detecting that the first marker has been placed in the detection area and that the second marker has been placed in the auxiliary detection area while the first image is being displayed on a display surface, and associating a feature of the first marker with the first input source; An image display method, including:

30. An image display method as described in Claim 29, wherein the detection area includes at least a portion of the display surface.

31. An image display method as described in claim 30, comprising displaying a detection guide image indicating the detection area on the display surface.

32. Detecting that the first marker has been placed in a first indication area included in the detection surface; and displaying the first image based on the first image data output from the first input source associated with the feature of the first marker on the display surface.

33. The image display method described in Claim 32, characterized in that the first indication area is an area that does not overlap with the detection area.

34. The display surface includes a first display area and a second display area, a second indication area corresponding to the second display area, When the first marker is detected in the first indication area, displaying the first image based on the first image data output from the first input source associated with a feature of the first marker in the first display area; 34. An image display method as described in claim 32 or claim 33, comprising, when the first marker is detected in the second indication area, displaying the first image based on the first image data output from the first input source associated with a characteristic of the first marker in the second display area.

35. Displaying a first image based on first image data output from a first input source on a display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; executing a process of associating a feature of the first marker with the first input source when it is detected that the first marker has been placed in the detection area while the first image is being displayed on a display surface; Detecting that the first marker has been placed in a first indication area included in the detection surface; when detecting that the first marker has been placed in the first indication area and that a second marker having the same characteristics as the characteristics of the first marker has been placed in an auxiliary detection area included in the detection surface, displaying the first image based on the first image data output from the first input source associated with the characteristics of the first marker on the display surface; An image display method, including:

36. An image display method as described in Claim 35, wherein the detection area includes at least a portion of the display surface.

37. An image display method as described in claim 36, comprising displaying a detection guide image indicating the detection area on the display surface.

38. The image display method described in Claim 35, characterized in that the first indication area is an area that does not overlap with the detection area.

39. Displaying a first image based on first image data output from a first input source on a display surface; Detecting that a first marker has been placed in a detection area included in the detection surface; when detecting that the first marker is placed in the detection area while the first image is being displayed on a display surface, associating a feature of the first marker with the first input source; Detecting that the first marker has been placed in a first indication area included in the detection surface; determining whether or not a feature of the first marker is associated with the first input source when it is detected that the first marker has been placed in the first pointing area; When it is determined that the feature of the first marker is associated with the first input source, displaying the first image based on the first image data output from the first input source associated with the feature of the first marker on the display surface; when it is determined that the feature of the first marker is not associated with the first input source, associating the feature of the first marker with the first input source; An image display method, including:

40. An image display method as described in Claim 39, wherein the detection area includes at least a portion of the display surface.

41. An image display method as described in claim 40, comprising displaying a detection guide image indicating the detection area on the display surface.

42. The image display method described in Claim 39, characterized in that the first indication area is an area that does not overlap with the detection area.

43. a light source; and a modulation device that modulates the light emitted by the light source to emit image light; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; A projector that, when detecting that the first marker has been placed in the detection area while projecting the first image, executes a process of associating the characteristics of the first marker with the first input source.

44. A light source; a modulation device that emits image light by modulating the light emitted by the light source; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; When detecting that the first marker has been placed in the detection area while the first image is being projected, a process of associating a feature of the first marker with the first input source is executed; and after associating the feature of the first marker with the first input source, displaying a display indicating that the association has been successful, by the projection device. projector.

45. A light source; a modulation device that emits image light by modulating the light emitted by the light source; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; When detecting that the first marker has been placed in the detection area while the first image is being projected, a process of associating a feature of the first marker with the first input source is executed; Detecting that the first marker has been placed in a first indication area included in the detection surface; projecting, by the projection device, the first image based on the first image data output from the first input source associated with the feature of the first marker onto the display surface; stopping the projection of the first image when the first marker is not detected in the first designation area while the first image is being projected onto the display surface; projector.

46. A light source; a modulation device that emits image light by modulating the light emitted by the light source; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source onto a first display area included in the display surface by the projection device; projecting a second image based on second image data input from a second input source onto a second display area included in the display surface by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; when it is detected that the first marker has been placed in the detection area, performing a process of associating the relative positions of the first image and the second image, the first input source, and the second input source with features of the first marker; projector.

47. A light source; a modulation device that emits image light by modulating the light emitted by the light source; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; A projector that detects that the first marker has been placed in the detection area and, when it detects that a second marker having the same characteristics as the characteristics of the first marker has been placed in an auxiliary detection area included in the detection surface, executes a process of associating the characteristics of the first marker with the first input source.

48. A light source; a modulation device that emits image light by modulating the light emitted by the light source; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; When detecting that the first marker has been placed in the detection area while the first image is being projected, a process of associating a feature of the first marker with the first input source is executed; Detecting that the first marker has been placed in a first indication area included in the detection surface; projecting, by the projection device, the first image based on the first image data output from the first input source associated with the feature of the first marker onto the display surface; when it is detected that the first marker has been placed in the first indication area and when it is detected that a second marker having the same characteristics as the characteristics of the first marker has been placed in an auxiliary detection area included in the detection surface, the projection device projects the first image based on the first image data output from the first input source associated with the characteristics of the first marker onto the display surface. projector.

49. A light source; a modulation device that emits image light by modulating the light emitted by the light source; a projection optical system that projects the image light onto a display surface; a projection device including: an imaging device that captures an image of a detection area included in the detection surface and outputs imaging data; a processor, The processor: projecting a first image based on first image data input from a first input source by the projection device; Detecting that a first marker has been placed in the detection area based on the photographing data; When detecting that the first marker has been placed in the detection area while the first image is being projected, a process of associating a feature of the first marker with the first input source is executed; Detecting that the first marker has been placed in a first indication area included in the detection surface; When it is detected that the first marker has been placed in the first pointing area, it is determined whether or not a feature of the first marker is associated with the first input source; When it is determined that the feature of the first marker is associated with the first input source, the first image based on the first image data output from the first input source associated with the feature of the first marker is projected onto the display surface; When it is determined that the feature of the first marker is not associated with the first input source, the projector executes a process of associating the feature of the first marker with the first input source.

Images