Display device control method and display device

Abstract

To provide a method for controlling a display unit that has improved usability for a user.SOLUTION: A projector 100 has an annotation mode for displaying an image based on received image data on a display surface with a display size corresponding to the resolution of the image data, and a white board mode for generating converted image data obtained by reducing the resolution of the received image data, and causing an image projection unit 170 to display an image based on the generated converted image data on a projection surface 3 with a display size corresponding to the resolution of the converted image data. When receiving an operation to increase the display size of the image displayed on the projection surface 3 in the white board mode, the projector converts the resolution of the converted image data to adjust the display size to a display size corresponding to the received operation, and displays an image based on the converted image data after the conversion on the projection surface 3.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a display device control method and a display device. [Background technology]

[0002] 2. Description of the Related Art Display devices are known that detect a position on a display surface pointed to by a pointer and display an image on the display surface based on the detected pointed position. For example, the device disclosed in Patent Document 1 has an annotation mode and a whiteboard mode. In the annotation mode, image data transmitted from an image output device is received, an image based on the image data is projected onto a projection surface as a projection image, and drawing is performed by superimposing the image on the projection image. In the whiteboard mode, the projection image is erased and drawing is performed on a white background. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-222280 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the annotation mode, the position and size of the projection surface onto which the projected image is projected are uniformly determined, and the position and size of the projected image cannot be easily changed by the user. Also, in the whiteboard mode, an image based on image data cannot be displayed as a projected image. [Means for solving the problem]

[0005] One aspect for solving the above problem is a control method for a display device having a first mode in which an image based on received image data is displayed on a display surface at a display size corresponding to the resolution of the image data, and a second mode in which converted image data is generated by reducing the resolution of the received image data, and an image based on the generated converted image data is displayed on the display surface at a display size corresponding to the resolution of the converted image data, and when an operation to enlarge the display size of an image displayed on the display surface is received in the second mode, the resolution of the converted image data is converted to a display size corresponding to the received operation, and an image based on the converted converted image data is displayed on the display surface.

[0006] One aspect for solving the above problem is a display device comprising a receiving unit that receives image data, a display unit that displays an image on a display surface, a resolution conversion unit that converts the resolution of the image data received by the receiving unit, a reception unit that accepts operations, and a control unit that causes the display unit to display an image based on the image data on the display surface, wherein the control unit has a first mode in which an image based on the image data received by the receiving unit is displayed on the display surface by the display unit at a display size corresponding to the resolution of the image data, and a second mode in which converted image data is generated by the resolution conversion unit to reduce the resolution of the image data received by the receiving unit, and an image based on the generated converted image data is displayed on the display surface by the display unit at a display size corresponding to the resolution of the converted image data, and when an operation to enlarge the display size of an image displayed on the display surface is accepted by the reception unit in the second mode, the resolution of the converted image data is converted to a display size corresponding to the accepted operation, and an image based on the converted converted image data is displayed on the display surface by the display unit. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a perspective view showing a schematic configuration of a display system. [Diagram 2] FIG. 1 is a block diagram showing a schematic configuration of a projector. [Diagram 3]FIG. 2 is a block diagram showing a schematic configuration of an image projection unit. [Figure 4] FIG. 13 is a diagram showing thumbnail images displayed at a reference position. [Diagram 5] FIG. 13 shows a state in which one of the thumbnail images is selected. [Figure 6] FIG. 13 is a diagram showing a state in which the size of a thumbnail image is enlarged. [Figure 7] FIG. 13 is a diagram showing a state in which a video object image is selected. [Figure 8] FIG. 13 is a diagram showing a state in which a video object image is rotated. [Figure 9] 6A and 6B are diagrams showing a state in which an area on the projection surface is selected by operating the light-emitting pen. [Figure 10] FIG. 13 is a diagram showing a state in which a captured image is displayed. [Figure 11] 4 is a flowchart showing the overall operation of the projector. [Figure 12] 4 is a flowchart showing the overall operation of the projector. [Figure 13] 10 is a flowchart showing the operation of the control unit when an operation to change the priority of a video object image is accepted. [Figure 14] 11 is a flowchart showing an update operation of a video object image. [Figure 15] FIG. 11 is a block diagram showing the configuration of a projector according to a first modified example. [Figure 16] FIG. 11 is a block diagram showing the configuration of a projector according to a second modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a perspective view showing a schematic configuration of a display system 1 according to an embodiment of the present invention.

[0009] 1, the display system 1 includes a projector 100 as a display device and a light-emitting pen 2 as a pointer. The projector 100 projects image light onto a projection surface 3 as a display surface, and displays a projected image 20 that is an image corresponding to the image light. The area of ​​the projection surface 3 onto which the projector 100 projects the image light is called a projection area 5. The projected image 20 displayed on the projection surface 3 by the projector 100 projecting image light includes an image based on a video signal supplied from an external image supply device 10 and an image in which a line is drawn along the locus of the pointing position on the projection surface 3 pointed to by the light-emitting pen 2. The image based on the video signal is hereinafter referred to as a video object image 30. The image in which a line is drawn along the locus of the pointing position of the light-emitting pen 2 is hereinafter referred to as a drawn image 40. The projected image 20 includes an OSD (On Screen Display) menu image and the like. The OSD menu image is hereinafter referred to as an OSD image 50.

[0010] 1 is fixed to a wall surface, and projects a projection image 20 toward a projection surface 3 arranged along the same wall surface. For example, a screen or a whiteboard can be used as the projection surface 3, but it may also be a mode in which an image is projected onto the wall surface itself. In addition, the installation mode of the projector 100 may be a mode in which a pedestal is placed at a certain distance from the projection surface 3, and the projector 100 is installed on the pedestal.

[0011] The light-emitting pen 2 includes a light-emitting unit 2a that emits infrared light, and a pressure detection unit that detects the pressure of the tip of the light-emitting pen 2 against the projection surface 3, i.e., the touch on the projection surface 3. The pressure detection unit is not shown. The light-emitting unit 2a repeatedly blinks in a predetermined light-emitting sequence while the light-emitting pen 2 is operating. The light-emitting unit 2a changes its light-emitting sequence depending on whether or not the projection surface 3 is touched. For this reason, the projector 100 can identify whether or not there is a touch by the light-emitting pen 2 based on the light-emitting sequence of the light-emitting unit 2a. The light-emitting pen 2 may be configured to emit light in a wavelength range other than infrared light.

[0012] The projector 100 includes an imaging unit 120. The imaging range of the imaging unit 120 is capable of imaging a range including the projection area 5. The projector 100 detects light emitted by the light-emitting pen 2 from the captured image, and detects the position of the detected light as a pointing position pointed to by the light-emitting pen 2. The projector 100 also detects whether or not the projection surface 3 has been touched, based on the light emission sequence of the detected light. The projector 100 can then display a pointer (not shown) at the detected pointing position, or display a drawn image 40 in which a line is drawn along the locus of the pointing position in a touched state.

[0013] FIG. 2 is a block diagram showing a schematic configuration of the projector 100. As shown in FIG. The schematic configuration of the projector 100 will be described with reference to FIG. The projector 100 includes an operation receiving section 110, an imaging section 120, a control section 130, a signal input section 140, an image processing unit 150, a second storage section 161, an internal drawing generating section 163, and an image projection section 170.

[0014] The operation reception unit 110 includes a plurality of operation keys for the user to give various instructions to the projector 100. The operation keys of the operation reception unit 110 include a power key for switching the power on and off, and a menu key for displaying a menu image for performing various settings. The operation keys also include direction keys for selecting an item on the menu image, and an input selection key for selecting an image interface into which image information is input. When the user operates various operation keys of the operation reception unit 110, the operation reception unit 110 accepts the operation and outputs an operation signal corresponding to the operation content to the control unit 130. Note that a configuration may be adopted in which a remote control (not shown) capable of remote control is used as the operation reception unit 110. In this case, the remote control transmits an infrared signal corresponding to the operation content of the user, and a remote control signal receiving unit (not shown) receives the infrared signal. The remote control signal receiving unit outputs an operation signal corresponding to the operation content indicated by the received infrared signal to the control unit 130.

[0015] The imaging unit 120 is a camera equipped with an imaging element (not shown), such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The imaging unit 120 has an infrared transmission filter that absorbs visible light and transmits infrared light, and captures an image of the infrared light emitted from the light-emitting pen 2 through this infrared transmission filter. Under the control of the control unit 130, the imaging unit 120 repeatedly captures an image of an area including the projection area 5 on the projection surface 3, and sequentially outputs the captured images, which are the imaging results, to the control unit 130.

[0016] The control unit 130 is a computer device including a first storage unit 131 and a processor 133. The control unit 130 generally controls the operation of the projector 100 by the processor 133 operating in accordance with a control program stored in the first storage unit 131.

[0017] The first storage unit 131 is configured with memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory). The RAM is used for temporary storage of various data and the like, and the ROM stores a control program for controlling the operation of the projector 100, various setting information, and the like. The first storage unit 131 stores calibration data. The calibration data is data that associates coordinates of an image captured by the imaging unit 120 with coordinates in the frame memory 157. A two-dimensional coordinate system is set for the captured image and the frame memory 157, and the calibration data uniquely identifies coordinates in the frame memory 157 that correspond to coordinates on the captured image.

[0018] The processor 133 is an arithmetic processing device including a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The processor 133 executes a control program to control each part of the projector 100. The processor 133 may be configured with a single processor, or may be configured with multiple processors. The processor 133 may be configured with a SoC integrated with part or all of the first storage unit 131 or other circuits. The processor 133 may be configured with a combination of a CPU that executes a program and a DSP that executes a predetermined arithmetic processing. Furthermore, the processor 133 may be configured with all of its functions implemented in hardware, or may be configured with a programmable device.

[0019] The control unit 130 of the projector 100 includes, as functional blocks realized by a control program, a detection unit 133A, a drawing image generation unit 133B, and a display control unit 133C. These functional blocks conveniently show functions realized by the processor 133 executing the control program.

[0020] The detection unit 133A detects infrared light emitted by the light emitting pen 2 from the captured image input from the imaging unit 120. The detection unit 133A regards an image of infrared light contained in the captured image that has a brightness equal to or greater than a predetermined threshold and a size within a predetermined range as light emitted by the light emitting pen 2, and detects its position as the pointing position of the light emitting pen 2. The detection unit 133A also determines the light emission sequence of the light emitting pen 2 based on the captured images acquired multiple times, and detects whether the projection surface 3 has been touched.

[0021] The drawn image generating unit 133B generates a drawn image 40 in which a line is drawn along the locus of the indicated position based on the detection result of the detection unit 133A. When the user performs a drawing operation such as drawing on the projection surface 3 with the light emitting pen 2, that is, when the indicated position changes with the light emitting pen 2 touching the projection surface 3, the drawn image generating unit 133B generates drawing data representing the drawn image 40 based on the locus of the indicated position. The drawn image generating unit 133B generates this drawing data, for example, in a vector format, stores it in the first storage unit 131, and updates it successively over time. The drawn image generating unit 133B also outputs the generated drawing data to the display control unit 133C.

[0022] In order to display the drawn image 40 generated by the drawn image generation unit 133B, the display control unit 133C converts the drawing data in vector format into a raster format and outputs the converted data to the internal drawing generation unit 163. In addition, the display control unit 133C performs control such as erasing or switching the drawn image 40 being displayed.

[0023] A video signal is input to the signal input unit 140 from an external image supply device 10 such as a computer or various video devices. The signal input unit 140 includes a plurality of input terminals 141 as an image interface connected to the image supply device 10, and an interface circuit 143. In this embodiment, the signal input unit 140 includes three input terminals 141, 141A, 141B, and 141C, but the number of input terminals 141 included in the signal input unit 140 is not limited to three. In the following, the interface is abbreviated as I / F. FIG. 2 shows an example in which an image supply device 10A and an image supply device 10B are connected to the projector 100. The image supply device 10A corresponds to a first image supply device, and the image supply device 10B corresponds to a second image supply device.

[0024] Examples of input terminals 141A, 141B, and 141C that the signal input unit 140 includes are as follows. An HDMI (High Definition Multimedia Interface) terminal for connecting to video equipment or computers that support HDMI. HDMI is a registered trademark. A computer terminal primarily used to input analog RGB signals from a computer. A video terminal primarily used to input composite signals from video equipment.

[0025] The I / F circuit 143 extracts image data and synchronization signals contained in the video signals input from the input terminals 141A, 141B, and 141C. The I / F circuit 143 outputs the extracted image data and synchronization signals to the image processing unit 150, and outputs the extracted synchronization signals to the control unit 130. The image processing unit 150 processes the image data for each frame in synchronization with the input synchronization signals. The control unit 130 controls each part of the projector 100 in synchronization with the input synchronization signals. The image data may be data of a moving image or data of a still image.

[0026] Furthermore, when the projector 100 and the image supply device 10 are connected by an HDMI cable, the I / F circuit 143 extracts an EDID (Extended Display Identification Data) signal included in the HDMI signal, which is a video signal. The I / F circuit 143 outputs the extracted EDID signal to the control unit 130.

[0027] The image processing unit 150 includes an image processing unit 151 , a scaling unit 153 , an image synthesis unit 155 , and a frame memory 157 . The image processing unit 151 loads the image data input from the signal input unit 140 into the frame memory 157, and performs various processes on the image data loaded into the frame memory 157 under the control of the control unit 130. For example, the image processing unit 151 performs processes on the image data, such as adjusting the brightness and contrast of the image, and adjusting the color mode.

[0028] The color mode is a mode for adjusting the color tone of the image projected onto the projection surface 3. For example, the projector 100 has, as color modes, a dynamic mode suitable for viewing in a bright environment, a living room mode suitable for viewing in dim light, a theater mode suitable for watching movies in a dark environment, and the like. Correction parameters corresponding to the color mode are input to the image processing unit 151 from the control unit 130. The image processing unit 151 uses the input correction parameters to perform correction such as gamma correction on the image data expanded in the frame memory 157, and adjusts the color mode of the image data.

[0029] The scaling unit 153 executes a scaling process for converting the resolution of the image data expanded in the frame memory 157. The scaling unit 153 corresponds to a resolution conversion unit. Furthermore, when the operation mode of projector 100 is the whiteboard mode, scaling unit 153 converts the resolution of the image data expanded in frame memory 157 and performs reduction processing to reduce the size of the image data. Image data generated by the reduction processing is called converted image data. Scaling unit 153 stores the generated converted image data in second storage unit 161.

[0030] Furthermore, when a plurality of image supply devices 10A, 10B are connected to the projector 100, the scaling unit 153 generates converted image data by reducing the resolution of image data extracted from the video signals supplied from these image supply devices 10A, 10B. The scaling unit 153 stores the generated converted image data in the second storage unit 161.

[0031] Here, the operation modes of the projector 100 will be described. The projector 100 has, as operation modes, an annotation mode which is a first mode, and a whiteboard mode which is a second mode.

[0032] The annotation mode is a mode in which an image based on a video signal is displayed on the projection surface 3 at a preset size and drawing is possible with the light-emitting pen 2. In other words, the annotation mode is a mode in which an image is displayed at a display size corresponding to the resolution of the image data included in the video signal. The whiteboard mode is a mode in which a video object image 30, which is an image based on a video signal, is displayed as an object on a white background, drawing is performed with the light-emitting pen 2, and a drawn image 40 is displayed on the projection surface 3. In this whiteboard mode, the display size and display position of the video object image 30 displayed as an object can be changed by operating the light-emitting pen 2.

[0033] The second storage unit 161 is configured with a memory such as a RAM (Random Access Memory), etc. The second storage unit 161 stores the converted image data that has been subjected to the reduction process by the scaling unit 153.

[0034] The internal drawing generation unit 163 includes a GPU (Graphics Processing Unit). Under the control of the control unit 130, the internal drawing generation unit 163 generates image data of the OSD image 50 to be displayed simultaneously with the image data, and acquires the drawing data generated by the control unit 130. The image data of the OSD image 50 is hereinafter referred to as OSD data. The OSD image 50 includes a pointer displayed at a designated position, a menu image, and the like. In the menu image, a plurality of icons corresponding to commands that the projector 100 can execute are displayed.

[0035] The internal drawing generation unit 163 has a function of converting the resolution of the converted image data stored in the second storage unit 161, and changing the size of the image projected on the projection surface 3. The internal drawing generation unit 163 corresponds to a resolution conversion unit. The internal drawing generation unit 163 converts the resolution of the converted image data into a resolution that corresponds to the display size set by operating the light-emitting pen 2. The user can operate the light-emitting pen 2 to enlarge or reduce the size of the image displayed on the projection surface 3. Hereinafter, the image displayed on the projection surface 3 based on the converted image data reduced by the scaling unit 153 is referred to as a thumbnail image 60. After that, the internal drawing generation unit 163 changes the resolution of the converted image data in accordance with a user's instruction, and the image displayed on the projection surface 3 based on the enlarged or reduced converted image data is referred to as a video object image 30.

[0036] When the operation mode of projector 100 is the whiteboard mode, internal drawing generation unit 163 outputs the OSD data, drawing data, and converted image data read from second storage unit 161 to image synthesis unit 155. At this time, in accordance with an instruction from control unit 130, internal drawing generation unit 163 also outputs to image synthesis unit 155 coordinate information indicating the coordinates of frame memory 157 in which the OSD data, drawing data, and converted image data are developed. In addition, the internal drawing generation unit 163 detects whether the operation mode of the projector 100 is Annotation mode, internal drawing generation unit 163 outputs the OSD data and drawing data to image synthesis unit 155. At this time, in accordance with an instruction from control unit 130, internal drawing generation unit 163 also outputs to image synthesis unit 155 coordinate information indicating the coordinates of frame memory 157 to which the OSD data and drawing data are to be developed.

[0037] Furthermore, when a plurality of image supply devices 10A, 10B are connected to the projector 100 and the internal drawing generation unit 163 receives video signals from these image supply devices 10A, 10B, the internal drawing generation unit 163 reads out converted image data corresponding to the image supply devices 10A, 10B, respectively. The internal drawing generation unit 163 outputs the read converted image data to the image synthesis unit 155 together with the OSD data and drawing data.

[0038] Image synthesis unit 155 expands at least one of the input OSD data, drawing data, and converted image data to coordinates in frame memory 157 indicated by the coordinate information. After expanding at least one of the OSD data, drawing data, and converted image data in frame memory 157, image synthesis unit 155 sequentially reads data from frame memory 157 and outputs the read data to image projection unit 170 as image information.

[0039] 3 is a block diagram showing a schematic configuration of image projection section 170. Image projection section 170 corresponds to a display section. The image projection section 170 includes a light source 171 , three liquid crystal panels 173 R, 173 G, and 173 B serving as a light modulation device 173 , an optical unit 175 , and a panel drive section 177 . The image projection section 170 modulates the light emitted from the light source 171 to generate image light, and projects the generated image light onto the projection surface 3 in an enlarged form by the optical unit 175 .

[0040] The light source 171 includes a discharge type light source lamp such as an extra-high pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light emitting diode or a semiconductor laser. The light emitted from the light source 171 is incident on the liquid crystal panels 173R, 173G, and 173B. The liquid crystal panels 173R, 173G, and 173B are each composed of a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. Each liquid crystal panel has a pixel region made up of a plurality of pixels arranged in a matrix, and a drive voltage can be applied to the liquid crystal for each pixel.

[0041] The panel driver 177 applies a drive voltage corresponding to the input image information to each pixel in the pixel region, and sets each pixel to a light transmittance corresponding to the image information. The light emitted from the light source 171 is modulated for each pixel by passing through the pixel regions of the liquid crystal panels 173R, 173G, and 173B, and image light corresponding to the image information is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesis optical system (not shown) to become image light representing a color image, and is enlarged and projected onto the projection surface 3 by the optical unit 175.

[0042] Next, an operation using the light-emitting pen 2 and an image projected onto the projection surface 3 will be described. In the whiteboard mode, when the image supply device 10 is connected to the signal input unit 140 and the supply of a video signal from the connected image supply device 10 starts, the control unit 130 causes the scaling unit 153 to perform a reduction process on the image data included in the supplied video signal. The scaling unit 153 stores the converted image data generated by the reduction process in the second storage unit 161. The control unit 130 controls the internal drawing generation unit 163, the image synthesis unit 155, and the image projection unit 170 to display the thumbnail image 60, which is an image based on the converted image data generated by the scaling unit 153, on the projection surface 3.

[0043] FIG. 4 is a diagram showing a thumbnail image 60 displayed at a reference position. The control unit 130 controls the internal drawing generation unit 163 to display the thumbnail image 60 at a preset reference position. The preset reference position may be, for example, the upper left area of ​​the projection surface 3. In addition, a plurality of reference positions may be set as the preset reference positions, and priorities may be set for the plurality of set reference positions. For example, reference positions may be set at the four corners of the projection surface 3, i.e., top, bottom, left, and right, and priorities may be set for each of the four corner positions. FIG. 4 shows a state in which a thumbnail image 60A based on a video signal supplied from the image supply device 10A and a thumbnail image 60B based on a video signal supplied from the image supply device 10B are displayed on the projection surface 3.

[0044] Furthermore, when the projection image 20 is already displayed at a preset reference position on the projection surface 3, the control unit 130 may detect an area where the projection image 20 is not projected, and display the thumbnail image 60 in the detected area on the projection surface 3. For example, when a video object image 30 is displayed at the reference position by a user operation, it is preferable that the newly displayed thumbnail image 60 is displayed so as not to overlap with the video object image 30 already displayed on the projection surface 3.

[0045] FIG. 5 is a diagram showing a state in which one of the thumbnail images has been selected by operating the light-emitting pen 2. As shown in FIG. Next, an operation will be described in the case where an operation to select a thumbnail image 60 and an operation to enlarge the display size of the selected thumbnail image 60 are accepted while the thumbnail image 60 is being displayed on the projection screen 3. The user touches the light-emitting pen 2 to the position on the projection surface 3 where the thumbnail image 60 that the user wants to select is displayed. Fig. 5 shows a state in which the thumbnail image 60B has been selected by operating the light-emitting pen 2. The control unit 130 detects the position on the projection surface 3 touched by the light-emitting pen 2 from the image captured by the imaging unit 120, and identifies the thumbnail image 60B displayed at this detected position on the projection surface 3. The control unit 130 displays a rectangular graphic 70 surrounding the selected thumbnail image 60B. Operators 71 are displayed at the four corners of the graphic 70 to accept operations such as enlarging or reducing the size of the image and rotating the image.

[0046] For example, the enlargement operation is an operation of touching the position of the operation button 71 with the light-emitting pen 2 and moving the touched light-emitting pen 2 to the outside of the thumbnail image 60B. Also, the reduction operation is an operation of touching the position of the operation button 71 with the light-emitting pen 2 and moving the touched light-emitting pen 2 to the inside of the thumbnail image 60B.

[0047] FIG. 6 is a diagram showing a state in which the size of the thumbnail image 60B has been enlarged by operating the light-emitting pen 2. As shown in FIG. When the control unit 130 receives an enlargement operation to enlarge the thumbnail image 60B by operating the light-emitting pen 2 on the operation unit 71, it instructs the internal drawing generation unit 163 of the conversion image data corresponding to the selected thumbnail image 60B and the resolution of the conversion image data to be changed. The internal drawing generation unit 163 converts the resolution of the converted image data specified by the control unit 130 so that the resolution becomes the resolution specified by the control unit 130. The internal drawing generation unit 163 outputs the converted image data whose resolution has been converted to the image synthesis unit 155 together with the OSD data and the drawing data.

[0048] Image synthesis unit 155 expands the input converted image data, OSD data, and drawing data in frame memory 157, reads out the data expanded in frame memory 157, and outputs the read data as image information to image projection unit 170. As a result, the selected thumbnail image 60B is enlarged to the display size specified by the user, and is displayed on projection surface 3 as video object image 30.

[0049] Even when the control unit 130 receives an operation to enlarge or reduce the display size of the video object image 30, it instructs the internal drawing generation unit 163 to specify the conversion image data corresponding to the selected video object image 30 and the resolution of the conversion image data to be changed. The internal drawing generation unit 163 converts the resolution of the converted image data specified by the control unit 130 so that the resolution becomes the resolution specified by the control unit 130. The internal drawing generation unit 163 outputs the converted image data whose resolution has been converted to the image synthesis unit 155 together with the OSD data and the drawing data. This allows the display size of the video object image 30 displayed on the projection surface 3 to be enlarged or reduced to a size designated by the user.

[0050] FIG. 7 shows a state in which the video object image 30 is selected, and FIG. 8 shows a state in which the selected video object image 30 has been rotated. Next, an operation performed when an operation to rotate the video object image 30 by operating the light emitting pen 2 is accepted will be described. The user touches the light emitting pen 2 to the position on the projection surface 3 where the video object image 30 that the user wants to select is displayed. The control unit 130 displays a graphic 70 surrounding the periphery of the selected video object image 30. Next, the user touches the position of the operation element 71 with the light-emitting pen 2, and rotates the touched light-emitting pen 2 clockwise or counterclockwise.

[0051] When the control unit 130 receives an operation to rotate the video object image 30, it instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected video object image 30 and to provide information on the rotation direction and rotation angle for rotating this converted image data. The internal drawing generation unit 163 rotates the converted image data specified by the control unit 130 by a specified rotation angle in a rotation direction specified by the control unit 130. The internal drawing generation unit 163 outputs the rotated converted image data to the image synthesis unit 155 together with the OSD data and the drawing data. This makes it possible to rotate the video object image 30 displayed on the projection surface 3 by a specified rotation angle in a rotation direction specified by the user.

[0052] Next, an operation when an operation to change the display position of the thumbnail image 60 or the video object image 30 by operating the light emitting pen 2 is accepted will be described. Here, a case will be described in which the image selected by the user is a video object image 30. The user touches the light-emitting pen 2 to the position on the projection surface 3 where the video object image 30 that the user wants to select is displayed. The control unit 130 detects the position on the projection surface 3 touched by the light-emitting pen 2 from the image captured by the imaging unit 120, and identifies the video object image 30 selected by the user. The control unit 130 displays a figure 70 that surrounds the periphery of the selected video object image 30. Next, while keeping the light-emitting pen 2 touching the selected video object image 30, the user moves the light-emitting pen 2 to the position to which the user wants to move the video object image 30.

[0053] The control unit 130 determines the direction and amount of movement of the light-emitting pen 2 from the captured image, and instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected video object image 30, as well as information on the direction and amount of movement for moving this converted image data. The internal drawing generation unit 163 calculates the coordinates of the frame memory 157 after the converted image data is moved, based on the movement direction and movement amount specified by the control unit 130. The internal drawing generation unit 163 outputs to the image synthesis unit 155 the converted image data specified by the control unit 130 and coordinate information of the frame memory 157 into which the converted image data is to be developed. This makes it possible to move the video object image 30 displayed on the projection surface 3 by a specified amount in a moving direction specified by the user.

[0054] Fig. 9 is a diagram showing a state in which an area on the projection surface 3 is selected by operating the light emitting pen 2. Fig. 10 is a diagram showing a state in which a captured image 80 that captures the selected area is displayed. Next, the operation when capturing an image is selected by operating the light-emitting pen 2 will be described. For example, assume that a capture command included in the OSD image 50 is selected with the video object image 30 and the drawing image 40 displayed on the projection surface 3, and the range of the projection surface 3 is selected by a touch operation of the light-emitting pen 2. In this case, the control unit 130 outputs range information of the frame memory 157 corresponding to the range of the projection surface 3 selected by the touch operation to the internal drawing generation unit 163. The internal drawing generation unit 163 outputs the range information to the image synthesis unit 155 and requests the capture of an image. The image synthesis unit 155 captures the image data expanded in the area of ​​the frame memory 157 indicated by the range information, and outputs the captured image data to the internal drawing generation unit 163. The internal drawing generation unit 163 stores the image data input from the image synthesis unit 155 in the second storage unit 161 as captured image data.

[0055] When the internal drawing generation unit 163 stores the captured image data in the second storage unit 161, it reads out the converted image data and the captured image data from the second storage unit 161 and outputs them to the image synthesis unit 155 together with the OSD data and the drawing data. At this time, the internal drawing generation unit 163 instructs the image synthesis unit 155 to develop the captured image data at the coordinates of the frame memory 157 where the converted image data is developed. The internal drawing generation unit 163 also instructs the image synthesis unit 155 to develop the converted image data to the right or left of the position where the captured image data is developed. The image synthesis unit 155 develops the captured image data, the OSD data, and the drawing data in the frame memory 157 according to the instruction of the internal drawing generation unit 163. The image synthesis unit 155 reads out the data developed in the frame memory 157 in order, and outputs the read data to the image projection unit 170 as image information. This makes it possible to display the captured image 80, which is a captured image of a range designated by the user, on the projection surface 3.

[0056] Next, a case where the supply of the video signal from the image supply device 10 is stopped will be described. When the supply of the video signal from the image supply device 10 that supplies the video signal stops, the control unit 130 erases the video object image 30 displayed on the projection surface 3 from the projection surface 3. At this time, if a captured image 80 of the video object image 30 is displayed on the projection surface 3, the display of this captured image 80 is not erased from the projection surface 3.

[0057] Next, a case where the supply of the video signal from the image supply device 10 is resumed will be described. When the image supply device 10 is reconnected to the projector 100 and the supply of the video signal from the image supply device 10 is resumed, the control unit 130 causes the projection surface 3 to display the video object image 30 based on the video signal supplied from the image supply device 10. At this time, for example, in the event of a temporary cable malfunction or a temporary interruption in the supply of the video signal, the control unit 130 determines, based on the EDID contained in the video signal, whether the source of the video signal before the interruption is the same as the source of the video signal after it is resumed. If the control unit 130 determines that the source of the video signal before the stop and the source of the video signal after the restart are the same, the control unit 130 displays the video object image 30 based on the video signal supplied from the image supply device 10 at the display position before the stop.

[0058] A priority is set for the video object image 30 projected on the projection surface 3. The control unit 130 may set the priority based on the display size of the projected image 20 on the projection surface 3. Furthermore, when multiple image object images 30 are displayed with overlapping permitted, the control unit 130 may set the priority of the image object image 30 with a higher overlap to be higher than that of the image object image 30 with a lower overlap. Furthermore, the control unit 130 may set the priority based on the time that has elapsed since the image object image 30 was subjected to processing such as enlargement or rotation by an operation such as enlargement or rotation of the light-emitting pen 2. In other words, the priority is set so that the shorter the time that has elapsed since the enlargement or rotation processing is performed on the image object image 30, the higher the priority is set.

[0059] When the priority of the video object image 30 is changed, the control unit 130 changes the size of the video object image 30 displayed on the projection surface 3 and changes the update frequency of the video object image 30 in accordance with the changed priority. The update frequency is the frequency at which the video object image 30 is updated based on the video signal supplied from the image supply device 10. Even if the update frequency of a video object image 30 that has a low priority and is less popular with users is increased, the bandwidth of the second storage unit 161 is wasted and the processing load of the projector 100 is increased.

[0060] Furthermore, the control unit 130 may set the priority of the video object image 30 selected by operating the light-emitting pen 2 to be the highest. When one video object image 30 is selected by operating the light emitting pen 2 while multiple video object images 30 are displayed on the projection surface 3, the control unit 130 sets the priority of the selected video object image 30 to the highest. The control unit 130 also sets the priority of the video object image 30 that was set to the highest priority before this video object image 30 was selected to second priority. Thereafter, the control unit 130 also changes the priority of other unselected video object images 30, and sets the priorities of the multiple video object images 30 to consecutive numbers.

[0061] The first storage section 131 stores setting information in which the update frequency and display size of the video object image 30 are set for each priority level. The control unit 130 refers to the setting information stored in the first storage unit 131 and controls the display size and update frequency of each of the multiple video object images 30. That is, the control unit 130 controls the internal drawing generation unit 163 so that the selected video object image 30 is updated more frequently than the other video object images 30. The control unit 130 also controls the internal drawing generation unit 163 so that the display size of the selected video object image 30 is larger than the other video object images 30. Furthermore, the update frequency of the video object image 30 may be changed according to the display size of the video object image 30 on the projection surface 3. By setting a higher update frequency for an image with a larger display size, it is possible to display an image that is attracting a lot of attention in its latest state.

[0062] 11 and 12 are flowcharts showing the overall operation of the projector 100. FIG. The operation of the projector 100 will be described with reference to the flowcharts of FIGS. First, the control unit 130 judges whether or not a video signal has been received (step S1). If the control unit 130 has not received a video signal (step S1 / NO), it judges whether or not a thumbnail image 60 or a video object image 30 has already been projected on the projection surface 3 (step S2). If the thumbnail image 60 or the video object image 30 has not already been displayed on the projection surface 3 (step S2 / NO), the control unit 130 returns to the judgment of step S1. If the thumbnail image 60 or the video object image 30 has already been displayed on the projection surface 3 (step S2 / YES), the control unit 130 proceeds to the judgment of step S6.

[0063] When the control unit 130 receives a video signal (step S1 / YES), the control unit 130 causes the signal input unit 140 to acquire image data included in the video signal (step S3). The signal input unit 140 outputs the acquired image data to the image processing unit 150.

[0064] The image processing unit 150 performs image processing on the input image data to adjust the brightness, contrast, and color mode, and then reduces the resolution of the image data by reduction processing to generate converted image data (step S4).

[0065] Next, the control unit 130 controls the internal drawing generation unit 163, the image synthesis unit 155, and the image projection unit 170 to display the thumbnail image 60, which is an image based on the converted image data generated by the image processing unit 150, at a reference position on the projection surface 3 (step S5).

[0066] Next, the control unit 130 analyzes the captured image and determines whether or not the thumbnail image 60 has been selected by the user's operation of the light-emitting pen 2 (step S6). If the thumbnail image 60 has been selected (step S6 / YES), the control unit 130 determines whether or not an enlargement operation to enlarge the thumbnail image 60 has been accepted (step S7).

[0067] When the control unit 130 receives an enlargement operation (step S7 / YES), it instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected thumbnail image 60 and the resolution of the converted image data to be changed. The internal drawing generation unit 163 converts the resolution of the converted image data specified by the control unit 130 to the resolution specified by the control unit 130 (step S8). Thereafter, the converted image data with the converted resolution is synthesized with the OSD data and the drawing data by the image synthesis unit 155, and is displayed on the projection surface 3 by the image projection unit 170. As a result, the video object image 30 enlarged to the size specified by the user is displayed on the projection surface 3 (step S9).

[0068] Next, if the accepted operation is not an enlargement operation (step S7 / NO) but an operation to change the display position of the thumbnail image 60 (step S10 / YES), the control unit 130 performs the following operation. That is, the control unit 130 specifies the movement direction and movement amount of the light-emitting pen 2 from the captured image, and instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected video object image 30 and information on the movement direction and movement amount for moving this converted image data. The internal drawing generation unit 163 calculates the coordinates of the frame memory 157 after the conversion image data is moved based on the movement direction and movement amount specified by the control unit 130. The internal drawing generation unit 163 outputs the converted image data specified by the control unit 130 and the coordinate information of the frame memory 157 to which this converted image data is expanded to the image synthesis unit 155. Thereafter, the image synthesis unit 155 expands the converted image data to the coordinates of the frame memory 157 indicated by the coordinate information specified by the internal drawing generation unit 163, thereby changing the display position of the thumbnail image 60 displayed on the projection surface 3 (step S11).

[0069] Next, the control unit 130 determines whether the accepted operation is Change the display position of thumbnail image 60If the operation is not an operation (step S10 / NO), the control unit 130 judges whether or not the video object image 30 has been selected (step S12). If the video object image 30 has not been selected (step S12 / NO), the control unit 130 proceeds to the judgment of step S25. If the control unit 130 has received an operation to select the video object image 30 (step S12 / YES), the control unit 130 judges whether or not an operation to enlarge or reduce the display size of the video object image 30 has been received (step S13).

[0070] When the control unit 130 receives an operation to enlarge or reduce the image (step S13 / YES), it instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected image object image 30 and the resolution of the converted image data to be changed. The internal drawing generation unit 163 changes the resolution of the converted image data to a resolution according to the operation (step S14), and the image object image 30 based on the converted image data with the changed resolution is displayed on the projection surface 3 (step S15).

[0071] Furthermore, if the accepted operation is not an operation for enlarging or reducing (step S13 / NO) but an operation for changing the display position of the video object image 30 (step S16 / YES), the control unit 130 performs the following operation. That is, the control unit 130 instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected video object image 30 and to provide information on the direction and amount of movement for moving the converted image data. Thereafter, the internal drawing generation unit 163 instructs the image synthesis unit 155 on the coordinates of the frame memory 157 after the movement, and the image synthesis unit 155 develops the converted image data at the coordinates of the frame memory 157 indicated by the coordinate information specified by the internal drawing generation unit 163. This changes the display position of the video object image 30 displayed on the projection surface 3 (step S17).

[0072] Moreover, if the accepted operation is not an operation to change the display position (step S16 / NO) but an operation to rotate the image (step S18 / YES), the control unit 130 performs the following operation. The control unit 130 instructs the internal drawing generation unit 163 to specify the converted image data corresponding to the selected video object image 30 and to provide information on the rotation direction and rotation angle for rotating the converted image data. After that, the internal drawing generation unit 163 rotates the specified converted image data by the specified rotation angle in the specified rotation direction to perform a rotation process. As a result, the video object image 30 displayed on the projection surface 3 is displayed in a state rotated by the specified rotation angle in the specified rotation direction (step S19).

[0073] Also, if the accepted operation is not an operation to rotate an image (step S18 / NO) but an instruction to capture an image (step S21 / YES), the control unit 130 performs the following operation. That is, the control unit 130 outputs range information of the frame memory 157 corresponding to the range of the projection surface 3 selected by the touch operation to the internal drawing generation unit 163. The internal drawing generation unit 163 causes the image synthesis unit 155 to capture image data of the area of ​​the frame memory 157 corresponding to the range information, and generates captured image data (step S22). After that, the image synthesis unit 155 moves the position of the frame memory 157 where the converted image data corresponding to the video object image 30 is developed (step S23). Then, the captured image data is developed at the position of the frame memory 157 where the converted image data was developed. As a result, the captured image 80 capturing the range designated by the user is displayed on the projection surface 3 (step S24).

[0074] If the received operation is not a capture instruction (step S21 / NO), the control unit 130 judges whether or not there is a video signal whose supply has been stopped (step S25). If there is a video signal whose supply has been stopped (step S25 / YES), the control unit 130 erases the display of the video object image 30 or thumbnail image 60 based on this video signal whose supply has been stopped from the projection surface 3 (step S26), and returns to the judgment of step S1. If the control unit 130 judges that there is no video signal whose supply has been stopped (step S25 / NO), the control unit 130 returns to the judgment of step S1.

[0075] FIG. 13 is a flowchart showing the operation of the control unit 130 when an operation to change the priority of a video object image 30 is accepted. First, the control unit 130 judges whether or not an operation to select a video object image 30 by operating the light-emitting pen 2 has been accepted (step S31). If the control unit 130 has not accepted an operation to select a video object image 30 (step S31 / NO), the control unit 130 waits to start processing until a video object image 30 is selected.

[0076] When the video object image 30 is selected (step S31 / YES), the control unit 130 judges whether or not a command for changing the priority has been selected by operating the light-emitting pen 2 (step S32). When the selected command is not a command for changing the priority of the video object image 30 (step S32 / NO), the control unit 130 executes a process corresponding to the selected command (step S33) and ends this processing flow.

[0077] Furthermore, when a command to change the priority of the video object image 30 is selected (step S32 / YES), the control unit 130 judges whether or not the priority of the selected video object image 30 is the first (step S34). When the priority of the selected video object image 30 is the first (step S34 / YES), the control unit 130 ends this processing flow.

[0078] Also, if the priority of the selected video object image 30 is not the first (step S34 / NO ), and changes the priority of the other video object images 30 that had been set to first to second (step S35). The control unit 130 also changes the priority of the other unselected video object images 30, setting them to consecutive priorities.

[0079] Next, the control unit 130 refers to the setting information stored in the first memory unit 131, changes the magnification ratio of the video object images 30 with a priority of second or lower to a small value corresponding to the changed priority, and reduces the update frequency to a frequency corresponding to the changed priority (step S36).

[0080] Next, the control unit 130 sets the priority of the selected video object image 30 to the first priority (step S37). The control unit 130 refers to the setting information and sets the enlargement ratio of the selected video object image 30 to the first priority (step S38). After change Change the magnification to the one that corresponds to the first priority. , more The new frequency is increased to the frequency corresponding to the first priority (step S38).

[0081] Thereafter, the control unit 130 outputs the designation of the converted image data and the corresponding magnification ratio to the internal drawing generation unit 163. The internal drawing generation unit 163 executes an enlargement process to enlarge the converted image data designated by the control unit 130 at the magnification ratio designated by the control unit 130. Then, the internal drawing generation unit 163 outputs the converted image data after the process and coordinate information indicating the coordinates of the frame memory 157 to which the converted image data is expanded to the image synthesis unit 155. The image synthesis unit 155 expands the input converted image data to the coordinates of the frame memory 157 indicated by the input coordinate information. Thereafter, the image synthesis unit 155 sequentially reads out the data expanded in the frame memory 157 and outputs the read out data to the image projection unit 170 as image information, so that image light corresponding to the image information is projected onto the projection surface 3.

[0082] 14 is a flowchart showing an update operation of the video object image 30. The update operation of updating the video object image 30 will be described with reference to the flowchart shown in FIG. The theory Reveal. First, control unit 130 acquires information about input terminals 141 that are receiving video signals from signal input unit 140, and creates a list of the video signals being received (step S41).

[0083] Next, the control unit 130 selects one video signal from the created list as a target video signal (step S42). Next, the control unit 130 acquires information on the update cycle of the selected video signal by referring to the setting information (step S43), and determines whether the selected video signal is a video signal to be updated for updating the video object image 30 (step S44).

[0084] If the selected video signal is not the video signal to be updated (step S44 / NO), the control unit 130 determines whether or not all video signals registered in the list have been selected as the target video signals (step S47). If all video signals registered in the list have been selected as the target video signals, the control unit 130 returns to the process of step S41. Moreover, when the control unit 130 has not selected all the video signals registered in the list as the target video signal (step S47 / NO), the control unit 130 returns to the process of step S42 and selects the target video signal.

[0085] If the selected video signal is a video signal to be updated (step S44 / YES), the control unit 130 judges whether or not it is time to update the selected video signal (step S45). If the control unit 130 judges that it is not time to update the selected video signal (step S45 / NO), the control unit 130 proceeds to step S47 and judges whether or not all video signals registered in the list have been selected as the target video signals.

[0086] Furthermore, when the selected video signal is at the update timing (step S45 / YES), the control unit 130 updates the video object image 30, which is an image based on the selected video signal. Specifically, the control unit 130 notifies the internal drawing generation unit 163 of the converted image data corresponding to the selected video signal. The internal drawing generation unit 163 reads the converted image data from the second storage unit 161, and outputs the read converted image data and coordinate information of the frame memory 157 in which the converted image data is expanded to the image synthesis unit 155. The image synthesis unit 155 expands the input converted image data to the coordinates of the frame memory 157 indicated by the input coordinate information. After that, the image synthesis unit 155 sequentially reads the data expanded in the frame memory 157, and outputs the read data to the image projection unit 170 as image information, so that the image light corresponding to the image information is projected on the projection surface 3. As a result, the video object image 30 corresponding to the selected video signal is updated (step S46).

[0087] [Variation 1] Next, a modification of the above-described embodiment will be described. FIG. 15 is a block diagram showing the configuration of a projector 100 according to the first modification. 15 is not configured to store converted image data reduced by the scaling unit 153 in the second storage unit 161, but rather to store image data extracted from a video signal received by the I / F circuit 143 in the second storage unit 161. In other words, the image data stored in the second storage unit 161 is data that has not been reduced by the scaling unit 153. The internal drawing generation unit 163 converts the resolution of the image data stored in the second storage unit 161 to generate converted image data, and stores the generated converted image data in the second storage unit 161.

[0088] [Variation 2] 16 is a block diagram showing the configuration of projector 100 of modification example 2. In the embodiment described above, the converted image data reduced by scaling unit 153 is stored in second storage unit 161, and internal drawing generation unit 163 converts the resolution of the converted image data so as to have a display size specified by control unit 130. In this second modification, image data processed by image processing unit 151 is input to scaling unit 153. Scaling unit 153 converts the resolution of the input image data to the resolution specified by control unit 130. Furthermore, when control unit 130 has generated drawing data, it outputs the drawing data to internal drawing generation unit 163. Furthermore, control unit 130 instructs internal drawing generation unit 163 on the coordinates of frame memory 157 in which image data, OSD data, and drawing data are to be developed. Internal drawing generation unit 163 outputs the drawing data and OSD data input from control unit 130 to image synthesis unit 155. The image synthesis unit 155 develops the image data, OSD data, and drawing data at the coordinates of the frame memory 157 specified by the internal drawing generation unit 163 .

[0089] As described above, the projector 100 of this embodiment has the annotation mode, which is the first mode, and the whiteboard mode, which is the second mode. The annotation mode is a mode in which an image based on received image data is displayed on the projection surface 3 at a display size corresponding to the resolution of the image data. The whiteboard mode is a mode in which converted image data is generated by reducing the resolution of the received image data, and an image based on the generated converted image data is displayed on the projection surface 3 by the image projection unit 170 at a display size corresponding to the resolution of the converted image data. When projector 100 receives an operation to enlarge the display size of an image displayed on projection surface 3 in the whiteboard mode, projector 100 converts the resolution of the converted image data so that the display size corresponds to the received operation. Then, projector 100 displays an image based on the converted image data after the conversion on projection surface 3. Therefore, when the operating mode of the projector 100 is the whiteboard mode, an image based on the received image data can be displayed on the projection surface 3 in a size that corresponds to the accepted operation, thereby improving user convenience.

[0090] Furthermore, the projector 100 updates the image based on the converted image data displayed on the projection surface 3 based on the received image data. The update frequency of the image based on the converted image data is changed according to the display size of the image based on the converted image data on the projection surface. Therefore, since the update frequency of the image based on the converted image data is changed according to the display size, it is possible to increase the update frequency for images with larger display sizes, so that images with large display sizes and high attention can be displayed in the latest state.

[0091] Furthermore, when the projector 100 is in whiteboard mode and receives first image data supplied from the image supply device 10A and second image data supplied from the image supply device 10B, the projector 100 generates first converted image data in which the resolution of the first image data is reduced, and second converted image data in which the resolution of the second image data is reduced, respectively. The projector 100 displays on the projection surface 3 a first image based on the first converted image data and a second image based on the second converted image data. Therefore, it is possible to display on the projection surface 3 images based on image data supplied from the multiple image supplies 10A and 10B.

[0092] Furthermore, when the projector 100 receives an operation to select either the first image or the second image, the projector 100 sets the priority of the selected image higher than the priority of an image that is not selected. The projector 100 converts the resolution of the first converted image data and the second converted image data so that the display size of an image set with a high priority is larger than the display size of an image set with a low priority. Furthermore, the projector 100 processes the first image data and the second image data received by the signal input unit 140 so that the update frequency of an image with a high priority is higher than the update frequency of an image with a low priority. Therefore, the priority of an image selected by the user can be set high, its display size can be set larger than other images, and its update frequency can be set higher than other images.

[0093] Moreover, when the projector 100 is unable to receive image data, it erases the display of the image based on the converted image data from the projection surface 3. When the supply of image data is resumed within a preset time from the same image supply device as the image data supply source, the projector 100 redisplays an image based on the converted image data at the position where the image display was erased. Therefore, even if the supply of image data is temporarily stopped, the image can be displayed again at the same position on the projection surface 3.

[0094] The above-described embodiment is a preferred embodiment of the present invention, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit of the present invention. For example, the I / F circuit 143, the image processing unit 150, and the internal drawing generation unit 163 may be configured with one or more processors, etc. Also, the I / F circuit 143, the image processing unit 150, and the internal drawing generation unit 163 may be configured with a dedicated processing device such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0095] In the above-described embodiment, the light modulation element included in the light modulation device 173 may be a transmissive liquid crystal panel or a reflective liquid crystal panel. The light modulation element may be configured using a digital mirror device, or may be configured by combining a digital mirror device with a color wheel. The light modulation device 173 may employ a configuration capable of modulating light emitted from a light source, other than a liquid crystal panel and a DMD.

[0096] Further, each functional unit of the projector 100 shown in FIG. 2 indicates a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other units of the projector can also be changed arbitrarily without departing from the spirit of the present invention.

[0097] 11 to 14 are divided according to the main processing contents in order to facilitate understanding of the processing of projector 100. The present invention is not limited by the manner of division or names of the processing units shown in the flowcharts of FIGS. 11 to 14. Furthermore, the processing of control unit 130 can be divided into more processing units according to the processing contents, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the drawings.

[0098] Furthermore, when the display device control method is realized using a computer included in the projector 100, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specific examples include portable or fixed recording media such as a flexible disk, HDD (Hard Disk Drive), CD-ROM, DVD, Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording medium. The recording medium may also be a non-volatile storage device such as RAM, ROM, or HDD, which is an internal storage device included in the server device. Blu-ray is a registered trademark. [Explanation of symbols]

[0099] 1...display system, 2...light-emitting pen, 3...projection surface, 5...projection area, 10, 10A, 10B...image supply device, 20...projected image, 30...video object image, 40...drawn image, 50...OSD image, 60, 60A, 60B...thumbnail image, 70...figure, 71...operator, 80...captured image, 100...projector, 110...operation reception unit, 120...imaging unit, 130...control unit, 131...first memory unit, 133...processor, 133A...detection unit, 133B...drawn image generation unit, 133C...display control unit, 140... Signal input section, 141...input terminal, 143...I / F circuit, 150...image processing unit, 151...image processing section, 153...scaling section, 155...image synthesis section, 157...frame memory, 161...second memory section, 163...internal drawing generation section, 167...frame memory, 170...image projection section, 171...light source, 173...light modulation device, 173R, 173G, 173B...liquid crystal panel, 175...optical unit, 177...panel driving section.

Claims

1. An image based on the received image data is displayed at a display size corresponding to the resolution of the image data. a first mode for displaying on the display surface; generating converted image data by reducing the resolution of the received image data; An image based on the converted image data is displayed in front at a display size corresponding to the resolution of the converted image data. and a second mode in which the display is displayed on the display surface, an operation of enlarging a display size of an image displayed on the display surface in the second mode When the user inputs a command, the converted image data is converted to a display size corresponding to the input command. and converting the resolution of the converted image data, and displaying an image based on the converted image data on the display screen. Displaying the image on the display surface; Based on the received image data, the converted image data is displayed on the display surface. Update the image, The update frequency of the image based on the converted image data is determined based on the converted image data on the display surface. A method for controlling a display device, the method comprising: changing a display size of an image based on the image;

2. An image based on the received image data is displayed at a display size corresponding to the resolution of the image data. a first mode for displaying on the display surface; generating converted image data by reducing the resolution of the received image data; An image based on the converted image data is displayed in front at a display size corresponding to the resolution of the converted image data. and a second mode in which the display is displayed on the display surface, an operation of enlarging a display size of an image displayed on the display surface in the second mode When the user inputs a command, the converted image data is converted to a display size corresponding to the input command. and converting the resolution of the converted image data, and displaying an image based on the converted image data on the display screen. Displaying the image on the display surface; When the image data cannot be received, the image based on the converted image data is displayed. from the display surface; Within a preset time, the image data is received from the same image supply device as the image data supply source. When the supply of data is resumed, the image based on the converted image data is displayed without erasing the image. A method for controlling a display device to cause an image to reappear in a position where it was removed.

3. An image based on the received image data is displayed at a display size corresponding to the resolution of the image data. a first mode for displaying on the display surface; generating converted image data by reducing the resolution of the received image data; An image based on the converted image data is displayed in front at a display size corresponding to the resolution of the converted image data. and a second mode in which the display is displayed on the display surface, an operation of enlarging a display size of an image displayed on the display surface in the second mode When the user inputs a command, the converted image data is converted to a display size corresponding to the input command. and converting the resolution of the converted image data, and displaying an image based on the converted image data on the display screen. Displaying the image on the display surface; In the second mode, the first image data is supplied from the first image supply device, and When the second image data supplied from the second image supply device is received, First converted image data obtained by reducing the resolution of the first image data and the second image data generating second converted image data having a reduced resolution; A first image based on the first converted image data and a second image based on the second converted image data. and displaying the image on the display surface; When an operation to select one of the first image and the second image is accepted, the selected image is Set the priority of selected images higher than the priority of unselected images, The display size of an image with a high priority is larger than the display size of an image with a low priority. The resolution of the first converted image data and the second converted image data is changed so that the resolution of the first converted image data and the second converted image data is increased. Let them exchange Images with a higher priority are updated more frequently than images with a lower priority. and processing the received first image data and the received second image data so as to obtain a display. A method for controlling the device.

4. A receiving unit that receives image data; A display unit that displays an image on a display surface; a resolution conversion unit that converts the resolution of the image data received by the receiving unit; A reception unit that receives an operation; a control unit that causes the display unit to display an image based on the image data on the display surface; Preparation, The control unit is The image based on the image data received by the receiving unit is converted into an image corresponding to the resolution of the image data. a first mode in which the display unit displays the image on the display surface in the display size determined by the first mode; The resolution of the image data received by the receiving unit is reduced by the resolution conversion unit. A converted image data is generated, and an image based on the generated converted image data is converted into the converted image data. a second mode in which the display unit displays the image on the display surface at a display size corresponding to the resolution of the image data; And, an operation of enlarging a display size of an image displayed on the display surface in the second mode When the accepting unit accepts the operation, the display size is adjusted to correspond to the accepted operation. The resolution of the converted image data is converted, and an image based on the converted image data is displayed on the display. and displaying the image on the display surface by the display unit as an image displayed on the display surface; Based on the received image data, the converted image data is displayed on the display surface. Update the image, The update frequency of the image based on the converted image data is determined based on the converted image data on the display surface. The display size of the image is changed depending on the display device.

5. A receiving unit that receives image data; A display unit that displays an image on a display surface; a resolution conversion unit that converts the resolution of the image data received by the receiving unit; A reception unit that receives an operation; a control unit that causes the display unit to display an image based on the image data on the display surface; Preparation, The control unit is The image based on the image data received by the receiving unit is converted into an image corresponding to the resolution of the image data. a first mode in which the display unit displays the image on the display surface in the display size determined by the first mode; The resolution of the image data received by the receiving unit is reduced by the resolution conversion unit. A converted image data is generated, and an image based on the generated converted image data is converted into the converted image data. a second mode in which the display unit displays the image on the display surface at a display size corresponding to the resolution of the image data; And, an operation of enlarging a display size of an image displayed on the display surface in the second mode When the accepting unit accepts the operation, the display size is adjusted to correspond to the accepted operation. The resolution of the converted image data is converted, and an image based on the converted image data is displayed on the display. and displaying the image on the display surface by the display unit as an image displayed on the display surface; When the image data cannot be received, the image based on the converted image data is displayed. from the display surface; Within a preset time, the image data is received from the same image supply device as the image data supply source. When the supply of data is resumed, the image based on the converted image data is displayed without erasing the image. A display device that causes the image to reappear in the position where it was removed.

6. A receiving unit that receives image data; A display unit that displays an image on a display surface; a resolution conversion unit that converts the resolution of the image data received by the receiving unit; A reception unit that receives an operation; a control unit that causes the display unit to display an image based on the image data on the display surface; Preparation, The control unit is The image based on the image data received by the receiving unit is converted into an image corresponding to the resolution of the image data. a first mode in which the display unit displays the image on the display surface in the display size determined by the first mode; The resolution of the image data received by the receiving unit is reduced by the resolution conversion unit. A converted image data is generated, and an image based on the generated converted image data is converted into the converted image data. a second mode in which the display unit displays the image on the display surface at a display size corresponding to the resolution of the image data; And, an operation of enlarging a display size of an image displayed on the display surface in the second mode When the accepting unit accepts the operation, the display size is adjusted to correspond to the accepted operation. The resolution of the converted image data is converted, and an image based on the converted image data is displayed on the display. and displaying the image on the display surface by the display unit as an image displayed on the display surface; In the second mode, the first image data is supplied from the first image supply device, and When the second image data supplied from the second image supply device is received, First converted image data obtained by reducing the resolution of the first image data and the second image data generating second converted image data having a reduced resolution; A first image based on the first converted image data and a second image based on the second converted image data. and displaying the image on the display surface; When an operation to select one of the first image and the second image is accepted, the selected image is Set the priority of selected images higher than the priority of unselected images, The display size of an image with a high priority is larger than the display size of an image with a low priority. The resolution of the first converted image data and the second converted image data is changed so that the resolution of the first converted image data and the second converted image data is increased. Let them exchange Images with a higher priority are updated more frequently than images with a lower priority. and processing the received first image data and the received second image data so as to obtain a display. Device.

Images