Method for controlling display system, display unit, and control device

Abstract

To provide a method for controlling a display system, a display unit, and a control device that increase the degree of freedom in arranging a plurality of images without improving the throughput of the display unit.SOLUTION: A control device 300 transmits, to a projector 200, output information including an output image 500B in which a first APP image 615 is arranged and position information indicating the position of an image arranged on a third screen 650. An image supply device 100 transmits image data to the projector 200. The projector 200 arranges an image based on the image data in the output image 500B on the basis of the position information to create a display image 500C, and displays the created display image 500C on a projection surface 30.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a control method, a display device, and a control device for a display system. [Background technology]

[0002] 2. Description of the Related Art Conventionally, a system is known in which images supplied from a plurality of image sources are displayed on one screen.

[0003] For example, Patent Document 1 discloses a multi-image display system that simultaneously displays multiple images on one display device, and includes a display area discrimination means and a cursor control means. The display area discrimination means of Patent Document 1 discriminates a display area in which a multi-screen control cursor is located on a multi-screen that simultaneously displays multiple images. The cursor control means sets a role for the multi-screen control cursor in the display area in accordance with the type of image source of the image to be displayed in the display area in which the multi-screen control cursor is located, and controls the multi-screen control cursor and its operation so that the cursor fulfills the set role. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2000-305543 A Summary of the Invention [Problem to be solved by the invention]

[0005] Giving a display device a function for adjusting the layout of multiple images increases the load on the display device, and the display device's processing power or functions must be improved. For this reason, there is a demand for increasing the degree of freedom in arranging multiple images without increasing the processing power of the display device. [Means for solving the problem]

[0006] The present disclosure is a control method for a display system, including: a control device transmitting output information to a display device, the output information including an output image in which a first image is placed and position information indicating a position of the output image in which a second image is placed; an image supply device transmitting the second image to the display device; the display device generating a display image by placing the second image in the output image based on the position information; and the display device displaying the display image.

[0007] The present disclosure relates to a display device that includes a first interface that connects to a control device, a second interface that connects to an image supply device, an optical device, and at least one processor, wherein the at least one processor performs the following operations: receiving output information via the first interface, the output information including an output image in which a first image is placed and positional information indicating a position on the output image in which a second image is to be placed; receiving the second image via the second interface; generating a display image by placing the second image on the output image based on the positional information; and displaying the display image using the optical device.

[0008] The present disclosure is a control device that includes at least one processor, the at least one processor performing the following operations: generating output information including an output image in which a first image is positioned and position information indicating a position of the output image in which a second image is to be positioned; and transmitting the output information to a display device. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing a system configuration of a display system. [Diagram 2] FIG. 1 is a block diagram showing the configuration of a projector. [Diagram 3] FIG. [Figure 4] FIG. [Diagram 5] FIG. 13 is a diagram showing a state in which an arrow image is displayed on a selected screen. [Figure 6]FIG. 13 shows an output image in which the display color of the third screen is changed to black. [Figure 7] 3A and 3B are diagrams showing a display image that a projector displays on a projection surface. [Figure 8] 4 is a flowchart showing the operation of the control device. [Figure 9] 4 is a flowchart showing the operation of the projector. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] [1. System configuration of the embodiment] FIG. 1 is a diagram showing a system configuration of a display system 1. As shown in FIG. The display system 1 includes an image supply device 100, a projector 200, and a control device 300.

[0012] FIG. 1 shows a configuration in which one image supply device 100 is connected to the projector 200, but the number of image supply devices 100 connected to the projector 200 is not limited to one, and a configuration in which two or more image supply devices 100 are connected may also be used.

[0013] The image supply device 100 is a device that supplies image data to the projector 200. For example, a notebook or desktop personal computer, or a smart device such as a smartphone, a smart stick, or a tablet terminal can be used as the image supply device 100. In addition, the image supply device 100 may be a recorder such as a DVD (Digital Versatile Disc), a BD (Blu-ray Disc), or a HDD (hard disk drive), or various STBs (Set Top Boxes), etc. Blu-ray is a registered trademark.

[0014] The projector 200 is a device that displays an image on a projection surface 30. The projection surface 30 may be, for example, a screen or a wall surface inside a room.

[0015] The projector 200 includes a plurality of image interfaces used for communicating image data, and a plurality of data interfaces used for communicating image data and control data. Hereinafter, the interface is also referred to as an I / F. In this embodiment, a case will be described in which the projector 200 includes an HDMI I / F 210 as an image I / F and a USB I / F 220 as a data I / F. The image I / F included in the projector 200 may be, for example, a display port, and the data I / F included in the projector 200 may be, for example, an Ethernet. HDMI and Ethernet are registered trademarks. In addition, the HDMI I / F 210 and the USB I / F 220 included in the projector 200 are collectively referred to as an input I / F.

[0016] FIG. 1 shows a case where the projector 200 includes a first HDMI I / F 211, a second HDMI I / F 213, and a third HDMI I / F 215 as the HDMI I / F 210. FIG. 1 also shows a case in which the projector 200 includes a first USB I / F 221 and a second USB I / F 223 as the USB I / F 220.

[0017] In this embodiment, a case will be described in which the image supply device 100 is connected to the first HDMI I / F 211, and the control device 300 is connected to the second HDMI I / F 213. Also, in this embodiment, a case will be described in which the control device 300 is connected to the first USB I / F 221. The first HDMI I / F 211 corresponds to the second interface.

[0018] The control device 300 generates output information that causes the projector 200 to display a display image 500C, and transmits the generated output information to the projector 200. The output information includes an output image 500B in which a plurality of screens are arranged. For example, images displayed by an application program installed in the control device 300 and images of a video file played by the control device 300 are displayed on the plurality of screens. Hereinafter, the application program is abbreviated as APP. The projector 200 generates a display image 500C based on the output information received from the control device 300, and displays the generated display image 500C on the projection surface 30.

[0019] The control device 300 includes an HDMI I / F 301 as an image I / F, and a USB I / F 303 as a data I / F. The image I / F included in the control device 300 may be, for example, a display port, and the data I / F included in the projector 200 may be, for example, an Ethernet.

[0020] In this embodiment, the HDMI I / F 301 is connected to the second HDMI I / F 213 of the projector 200 via a cable 5, and the USB I / F 303 is connected to the first USB I / F 221 of the projector 200 via a cable 7. The HDMI I / F 301 or the USB I / F 303 of the control device 300 and the second HDMI I / F 213 or the first USB I / F 221 of the projector 200 correspond to a first interface.

[0021] In addition, when the HDMI I / F 301 has a male connector and the second HDMI I / F 213 has a female connector, the male connector of the HDMI I / F 301 may be directly connected to the female connector of the second HDMI I / F 213.

[0022] [2. Projector configuration] FIG. 2 is a block diagram showing the configuration of the projector 200. Next, the configuration of the projector 200 will be described with reference to FIG. In order to simplify the illustration, FIG. 2 shows a first HDMI I / F 211 and a second HDMI I / F 213 as image I / Fs, and a first USB I / F 221 as a data I / F, and omits the illustration of the other HDMI I / Fs 210 and USB I / F 220.

[0023] The projector 200 includes an HDMI I / F 210, a USB I / F 220, an image processing unit 240, a frame memory 245, an image projection unit 250, and a first control unit 270.

[0024] The first HDMI I / F 211, the second HDMI I / F 213, and the third HDMI I / F 215 each include a connection port and an interface circuit that are compatible with the HDMI standard. The first USB I / F 221 and the second USB I / F 223 include a connection port and an interface circuit that comply with the USB standard.

[0025] A frame memory 245 is connected to the image processing unit 240. The image processing unit 240 loads an image based on image data received by the HDMI I / F 210 or the USB I / F 220 into the frame memory 245. The image processing unit 240 performs image processing such as resolution conversion processing, resizing processing, distortion correction, shape correction processing, digital zoom processing, and adjustment of color tone and brightness of the image, on the image loaded into the frame memory 245. The image processing unit 240 outputs image information, which is information on the image loaded into the frame memory 245, to a panel driving unit 257 of the image projection unit 250.

[0026] The frame memory 245 and the image processing unit 240 are configured, for example, by an integrated circuit. The integrated circuit includes an LSI (Large Scale Integrated Circuit), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), and an SoC (System-on-a-chip). The frame memory 245 and the image processing unit 240 may include an analog circuit as part of the integrated circuit configuration, or may be configured by combining the first control unit 270 with an integrated circuit.

[0027] The image projection unit 250 includes a light source 251, a light modulation device, and a panel drive unit 257. The light modulation device includes three liquid crystal panels 253(R), 253(G), and 253(B), and a projection lens 255 which is an optical system unit.

[0028] The light source 251 includes a solid-state light source such as a light-emitting diode or a semiconductor laser. A discharge-type light source lamp such as an extra-high pressure mercury lamp or a metal halide lamp may be used as the light source 251. The light source 251 emits light that is the source of image light under the control of the first control unit 270. The light emitted by the light source 251 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and is separated into the three primary colors of light, red (R), green (G), and blue (B), by a color separation optical system (not shown). After that, the light separated into the red (R), green (G), and blue (B) color components is incident on the liquid crystal panels 253(R), 253(G), and 253(B), respectively. The light separated into the color components incident on the liquid crystal panels 253(R), 253(G), and 253(B) is called color light.

[0029] The liquid crystal panels 253(R), 253(G), and 253(B) are each formed of a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. The liquid crystal panels 253(R), 253(G), and 253(B) are formed with rectangular image forming areas 254(R), 254(G), and 254(B) each made up of a plurality of pixels arranged in a matrix, and a driving voltage can be applied to each pixel. The projector 200 is configured to use the liquid crystal panels 253(R), 253(G), and 253(B), but is not limited to this. A reflective liquid crystal panel or an LCOS (Liquid Crystal On Silicon) liquid crystal panel may be provided. The projector 200 may be configured to include one or more DMDs (Digital Mirror Devices).

[0030] The panel driving unit 257 forms an image in the image forming areas 254(R), 254(G), and 254(B) of the liquid crystal panels 253(R), 253(G), and 253(B). Specifically, the panel driving unit 257 applies a driving voltage corresponding to the image information input from the image processing unit 240 to each pixel of the image forming areas 254(R), 254(G), and 254(B) in accordance with an instruction from the first control unit 270. This sets each pixel of the image forming areas 254(R), 254(G), and 254(B) to a light transmittance corresponding to the image information. The light emitted from the light source 251 is modulated for each pixel by passing through the image forming areas 254(R), 254(G), and 254(B) of the liquid crystal panels 253(R), 253(G), and 253(B), and an image light corresponding to the image information is formed for each color light. The image lights of each color thus formed are synthesized for each pixel by a color synthesis optical system (not shown) to become image light that represents a color image, and is enlarged and projected onto the projection surface 30 by the projection lens 255 .

[0031] The first control unit 270 includes a first storage unit 280 and a first processor 290.

[0032] The first storage unit 280 includes at least a non-volatile storage device. The first storage unit 280 may also include a volatile storage device. The non-volatile storage device may be, for example, a Read Only Memory (ROM), a flash memory, or an Electrically Erasable Programmable Read-Only Memory (EEPROM).

[0033] The first storage unit 280 is used as a calculation area for the first processor 290. In addition, the first storage unit 280 stores a control program 285 executed by the first processor 290, setting data related to the operation of the projector 200, and the like.

[0034] The first processor 290 is an arithmetic processing device including a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The first processor 290 may be configured with a single processor, or may be configured with multiple processors. The first processor 290 may be configured with a part or all of the first storage unit 280 or a system on a chip (SoC) integrated with other circuits. The first processor 290 may be configured with a combination of a CPU that executes a program and a DSP (Digital Signal Processor) that executes a predetermined arithmetic processing. Furthermore, all of the functions of the first processor 290 may be implemented in hardware, or may be configured using a programmable device.

[0035] [3. Control device configuration] Returning to FIG. 1, the configuration of the control device 300 will be described. The control device 300 includes an HDMI I / F 301 , a USB I / F 303 , a remote control light receiving unit 310 , and a second control unit 330 .

[0036] The HDMI I / F 301 includes a connection port and an interface circuit that are compatible with the HDMI standard. The USB I / F 303 includes a connection port and an interface circuit that are compatible with the USB standard.

[0037] The remote control light receiving unit 310 is a receiving device for an infrared signal, and includes a light receiving element, a decoder, and the like (not shown). The remote control light receiving unit 310 receives and decodes an infrared signal transmitted from the remote control 320. The remote control light receiving unit 310 decodes the infrared signal, and outputs an instruction signal corresponding to an operation key or button operated on the remote control 320 to the second control unit 330. The remote control light receiving unit 310 may be configured to receive a wireless signal such as Bluetooth from the remote control 320. When receiving a wireless signal, the remote control light receiving unit 310 may include an antenna and a receiving circuit. Bluetooth is a registered trademark.

[0038] The remote control 320 includes, for example, a screen split button, a cross key corresponding to each of the up, down, left, and right directions, a back button for undoing a received operation, a zoom-in button, a zoom-out button, a decision button for finalizing a received operation, etc. The screen split button is a button for causing the projector 200 to display a display image having multiple screens.

[0039] In this embodiment, an example in which a dedicated remote control 320 for operating the control device 300 is provided will be described, but the remote control 320 may be a mobile terminal such as a smartphone. In this case, operation keys and the like are displayed on the touch panel of the mobile terminal by application software installed in the mobile terminal.

[0040] The second control unit 330 includes a second memory unit 340 and a second processor 360 .

[0041] The second storage unit 340 includes at least a non-volatile storage device. The second storage unit 340 may also include a volatile storage device. The non-volatile storage device may be, for example, a ROM, a flash memory, or an EEPROM.

[0042] The second storage unit 340 is used as a calculation area for the second processor 360. The second storage unit 340 also stores an OS (Operating System) 341 executed by the second processor 360 and an APP 350. In this embodiment, a case will be described in which the second storage unit 340 stores two APPs, a first APP 351 and a second APP 353, as the APP 350. In addition, the second storage unit 340 may store moving image files and still image files.

[0043] The second processor 360 is an arithmetic processing device including a processor such as a CPU or an MPU. The second processor 360 may be configured with a single processor, or may be configured with multiple processors. The second processor 360 may be configured with an SoC integrated with a part or all of the second storage unit 340 or other circuits. The second processor 360 may be configured with a combination of a CPU that executes a program and a DSP that executes a predetermined arithmetic processing. Furthermore, the second processor 360 may be configured with all of its functions implemented in hardware, or may be configured using a programmable device.

[0044] [4. Display system operation] Next, the operation of the display system 1 will be described. The display system 1 is a system that displays images supplied to the projector 200 by the image supply device 100 and the control device 300 by multi-screen display. An image that the projector 200 displays on the projection surface 30 is called a display image 500C. The display image 500C includes a plurality of screens 600. Below, a case will be described in which the display image 500C includes three screens 600, namely a first screen 610, a second screen 630, and a third screen 650, but the number of screens 600 included in the display image 500C is arbitrary.

[0045] On the first screen 610, the second screen 630 and the third screen 650, an APP 350 installed in the control device 300 and images based on image data supplied from the image supply device 100 are displayed.

[0046] In order to cause the projector 200 to display the display image 500C, the image supply device 100 transmits image data to the projector 200, and the control device 300 transmits output information to the projector 200.

[0047] In order to explain the output information, the operation of the control device 300 will be explained. When the user presses the screen division button on the remote control 320, the second control unit 330 receives an operation signal from the remote control light receiving unit 310 indicating that the screen division button has been operated.

[0048] When an operation signal of the screen division button is input, the second control unit 330 transmits image data of the source setting screen 400 shown in Fig. 3 to the projector 200. The projector 200 generates image light based on the input image data, and projects the generated image light onto the projection surface 30.

[0049] FIG. 3 is a diagram showing a source setting screen 400 displayed on the projection surface 30. As shown in FIG. The source setting screen 400 includes a source list 410 and a setting field 430. A cursor 3 is also displayed on the source setting screen 400. The display position of the cursor 3 on the source setting screen 400 can be changed by operating the cross key of the remote control 320.

[0050] A list of sources is displayed in the source list 410. In the source list 410, the HDMI I / F 210 and the USB I / F 220 provided in the projector 200, and the APP 350 installed in the control device 300 are displayed as sources.

[0051] The setting field 430 is a field for setting a source to be displayed on the projector 200 from among the multiple sources displayed in the source list 410. The setting field 430 includes a first screen setting field 450, a second screen setting field 470, and a third screen setting field 490. In the first screen setting field 450, a toggle button 455 is displayed for each source displayed in the source list 410, and in the second screen setting field 470, a toggle button 475 is displayed for each source displayed in the source list 410. In the third screen setting field 490, a toggle button 495 is displayed for each source displayed in the source list 410.

[0052] The user operates the cross key of the remote control 320 to move the cursor 3 to the display position of the toggle button 455 corresponding to the source that the user wants to display on the first screen 610, and presses the decision button of the remote control 320. This changes the state of the toggle button 455 that the cursor 3 is over from OFF to ON. The user operates the remote control 320 to set the second screen 630 and the third screen 650 in the same way.

[0053] In the following description, it is assumed that the first APP 351 is set as the source in the first screen setting field 450, and the second APP 353 is set as the source in the second screen setting field 470. Also, it is assumed that the first HDMI I / F 211 is set as the source in the third screen setting field 490.

[0054] Next, the user presses the enter button provided on the remote control 320. The second control unit 330 accepts the settings on the source setting screen 400 when the enter button is pressed.

[0055] Next, the second control unit 330 starts the first APP 351 and the second APP 353 set on the source setting screen 400, and generates image data of the adjusted image 500A including the first screen 610, the second screen 630, and the third screen 650. The second control unit 330 transmits the image data of the generated adjusted image 500A to the projector 200, and causes the projector 200 to display the adjusted image 500A.

[0056] FIG. 4 is a diagram showing an adjusted image 500A. The adjusted image 500A includes a first screen 610, a second screen 630, and a third screen 650. When the second control unit 330 causes the projector 200 to display the adjusted image 500A for the first time after the user has performed settings on the source setting screen 400, the second control unit 330 causes the first screen 610, the second screen 630, and the third screen 650 to be displayed at default display sizes and display positions.

[0057] In the first screen 610, a first APP image 615 which is an image displayed by the first APP 351 is displayed, and in the second screen 630, a second APP image 635 which is an image displayed by the second APP 353 is displayed. In the third screen 650, an image of a frame indicating the range of the third screen 650 is displayed. The first APP image 615 and the second APP image 635 correspond to the first image.

[0058] The user can operate the remote control 320 to change the display size and display position of the first screen 610, the second screen 630, and the third screen 650 in the adjusted image 500A. First, the user operates the cross key of the remote control 320 to change the display position of the cursor 3 so that it overlaps with the screen 600 for which the user wishes to change the display position or display size. When the cursor 3 overlaps with the screen 600 for which the user wishes to change the display position or display size, the user presses the enter button.

[0059] FIG. 5 is a diagram showing a state in which an arrow image 510 is displayed on a screen 600 that is the target for changing the display position or size. When the enter button of the remote control 320 is pressed briefly, the second control unit 330 displays an arrow image 510 around the screen 600 on which the cursor 3 is overlapped. Fig. 5 shows a state in which an arrow image 511 indicating the upward direction is displayed on an upper side 651 of the third screen 650, and an arrow image 513 indicating the downward direction is displayed on a lower side 653. Also, a state in which an arrow image 515 indicating the left direction is displayed on a left side 655, and an arrow image 517 indicating the upward direction is displayed on a right side 657.

[0060] Next, the user presses the cross key in the direction in which the user wishes to move third screen 650. Second control unit 330 moves third screen 650 in the direction of the pressed cross key while the cross key is being pressed. Furthermore, when the user moves the third screen 650 to the position of the adjusted image 500A where the user wants to display the third screen 650, he or she presses the decision button provided on the remote control 320. When the decision button on the remote control 320 is pressed, the second control unit 330 finalizes the display position of the third screen 650.

[0061] Also, when enlarging or reducing the display size of the third screen 650, the user operates the cross key of the remote control 320 to place the cursor 3 on the screen 600 whose display position or display size is to be changed, and presses the decision button. When changing the display size of the screen 600, the decision button may be pressed twice in succession, or the decision button may be pressed and held. In this embodiment, it is assumed that when the user performs an operation of pressing and holding the decision button, the second control unit 330 is in a state in which it is possible to accept the operation of the enlargement button or reduction button provided on the remote control 320. In this state, the user presses the enlargement button or reduction button provided on the remote control 320. The second control unit 330 enlarges or reduces the display size of the screen 600 on which the cursor 3 is placed while the enlargement button or reduction button is being pressed.

[0062] When the user completes adjustment of the display position and display size of the screen 600 in the adjusted image 500A, the user moves the cursor 3 to a position where it does not overlap the screen 600, and presses the enter button on the remote control 320. When the enter button of the remote control 320 is pressed with the cursor 3 not overlapping the screen 600, the second control unit 330 determines that the processing on the adjusted image 500A is completed. Then, the second control unit 330 generates output information to be output to the projector 200.

[0063] FIG. 6 shows an output image 500B in which the display color of the third screen 650 has been changed to black. The second control unit 330 changes the display color of the third screen 650 to a color different from the display color of the area other than the area displaying the screen 600 of the adjusted image 500A. Specifically, the third screen 650 is the screen 600 that displays the image supplied by the image supply device 100. The area other than the area displaying the screen 600 is hereinafter referred to as the background area. For example, when the display color of the background area is white, the display color of the third screen 650 is changed to black. The third screen 650 corresponds to the area in which the second image is arranged. An image in which the display color of the screen 600 that displays the image supplied by the image supply device 100 is changed to black is referred to as the output image 500B. Black is the first color and corresponds to a preset color.

[0064] The second control unit 330 may generate, as output information, the adjusted image 500A and information indicating the position and size of the adjusted image 500A on the screen 600 on which the image supplied by the image supply device 100 is displayed. The information indicating the position and size is called screen information. The screen information corresponds to position information. The information indicating the position is, for example, information indicating the coordinates of the upper left and lower right of the screen 600 on which the image supplied by the image supply device 100 is displayed, with the upper left of the adjusted image 500A shown in FIG. 4 as the origin, the horizontal direction as viewed in the drawing as the X axis, and the vertical direction as the Y axis. The information indicating the size is, for example, information indicating the vertical and horizontal resolutions of the screen 600 on which the image supplied by the image supply device 100 is displayed. When the information indicating the position and size is generated as output information, the display color of the screen 600 of the output image 500B may be other than black. For example, the display color of the screen 600 may be blue. The display color of the screen 600 may be white when the display color of the background area is white.

[0065] When the second control unit 330 generates the output image 500B, it transmits the generated output image 500B and source information indicating the source of the image to be displayed on the third screen 650 as output information to the projector 200. In the case of the present embodiment, the source information indicating the source is information indicating the first HDMI I / F 211. The second control unit 330 transmits the output information to the projector 200 via the USB I / F 303. Alternatively, the second control unit 330 may transmit the output image 500B to the projector 200 via the HDMI I / F 301, and transmit the source information to the projector 200 via the USB I / F 303.

[0066] Furthermore, when the second control unit 330 generates the adjusted image 500A and the screen information, it transmits these pieces of information and source information indicating the source of the image to be displayed on the third screen 650 to the projector 200 as output information. The second control unit 330 transmits the output information to the projector 200 via the USB I / F 303. Furthermore, the second control unit 330 may transmit the adjusted image 500A to the projector 200 via the HDMI I / F 301, and transmit the screen information and source information to the projector 200 via the USB I / F 303.

[0067] When the first control unit 270 receives the output image 500B and the source information as the output information, it detects the area of ​​the black screen 600 included in the output image 500B. Specifically, the first control unit 270 detects the area of ​​the black screen 600 by detecting pixels having a predetermined pixel value among the pixels of the output image 500B. The pixel value of the black screen 600 is, for example, (R, G, B) = (0, 0, 0). The first control unit 270 determines that the area of ​​the black screen 600 is a case where a predetermined number or more of pixels of (R, G, B) = (0, 0, 0) are consecutively arranged in both the vertical direction and the horizontal direction of the output image 500B. The predetermined number is, for example, 100. The predetermined number is not limited to 100, and may be any size that can display image data described later. The first control unit 270 sets the smallest rectangle that includes all the pixels of the detected black screen 600, and for example, sets the coordinates of the viewpoint of the rectangle as the position of the detected area of ​​the black screen 600. The first control unit 270 also sets the number of pixels in the vertical and horizontal directions of the rectangle as the resolution of the detected area of ​​the black screen 600. If information indicating the position and size is received as output information, the information indicating the position and size is used for subsequent processing. If information indicating the position and size is received, the process of detecting the area of ​​the black screen 600 does not need to be performed. The first control unit 270 compares the resolution of the detected area of ​​the black screen 600 with the resolution of the image data input to the first HDMI I / F 211 indicated by the source information. If the resolution of the image data input to the HDMI I / F 211 does not match the resolution of the detected area of ​​the black screen 600, the first control unit 270 executes a resolution conversion process to convert the resolution of the image data input to the first HDMI I / F 211. The first control unit 270 executes a resolution conversion process of the image data input to the first HDMI I / F 211 so that the resolution of the image data input to the first HDMI I / F 211 matches the resolution of the area of ​​the black screen 600. The image data input to the first HDMI I / F 211 corresponds to the second image.

[0068] Furthermore, when the first control unit 270 receives the adjusted image 500A, the screen information, and the source information, it compares the vertical and horizontal resolutions of the screen 600 indicated by the screen information with the resolution of the image data input to the first HDMI I / F 211 indicated by the source information. If the resolution of the image data input to the first HDMI I / F 211 does not match the vertical and horizontal resolutions of the screen 600 indicated by the screen information, the first control unit 270 executes a resolution conversion process to convert the resolution of the image data input to the first HDMI I / F 211. The first control unit 270 executes a resolution conversion process of the image data input to the first HDMI I / F 211 so that the resolution of the image data input to the first HDMI I / F 211 matches the vertical and horizontal resolutions of the screen 600 indicated by the screen information.

[0069] Next, the first control unit 270 outputs to the image processing unit 240 the image data that has been subjected to the resolution conversion process and the output image 500B. Image processing unit 240 develops output image 500B input from first control unit 270 in frame memory 245, and superimposes the input image data on black screen 600 of developed output image 500B. Fig. 7 is a diagram showing display image 500C in which input image data is superimposed on black screen 600 of output image 500B.

[0070] Moreover, the first control unit 270 outputs to the image processing unit 240 the image data that has been subjected to the resolution conversion process, the adjusted image 500A, and the screen information. The first control unit 270 develops the adjusted image 500A input from the first control unit 270 in the frame memory 245. The first control unit 270 superimposes the input image data at the position of the adjusted image 500A indicated by the screen information.

[0071] Next, the image processing unit 240 reads out image information, which is information on the image developed in the frame memory 245, and outputs it to the image projection unit 250. The image information is input to a panel driving unit 257 of the image projection unit 250.

[0072] The panel driving section 257 applies a driving voltage corresponding to the image information input from the image processing section 240 to each pixel of the image forming areas 254(R), 254(G), and 254(B). Image light is generated by the light emitted from the light source 251 passing through the image forming areas 254(R), 254(G), and 254(B) of the liquid crystal panels 253(R), 253(G), and 253(B), and the generated image light is projected onto the projection surface 30 by the projection lens 255. As a result, the display image 500C shown in FIG. 7 is displayed on the projection surface 30.

[0073] FIG. 8 is a flowchart showing the operation of the control device 300. The operation of the control device 300 will be described with reference to the flow chart shown in FIG. First, the second control unit 330 judges whether or not an operation signal corresponding to the screen split button has been input (step S1). The operation signal corresponding to the screen split button is a signal that the remote control light receiving unit 310 outputs to the second control unit 330 when the screen split button is pressed. If an operation signal corresponding to the screen split button has not been input (step S1 / NO), the second control unit 330 waits until an operation signal is input.

[0074] When an operation signal of the screen division button is input (step S1 / YES), second control unit 330 transmits image data of the source setting screen 400 to projector 200, and causes projector 200 to display the source setting screen 400 on projection surface 30 (step S2).

[0075] Next, the second control unit 330 determines whether or not an operation signal corresponding to the decision button has been input (step S4) while changing the display of the source setting screen 400 according to the operation signal input from the remote control light receiving unit 310 (step S3). The operation signal corresponding to the decision button is a signal output from the remote control light receiving unit 310 to the second control unit 330 when the decision button is pressed.

[0076] If an operation signal corresponding to the enter button is not input (step S4 / NO), the second control unit 330 returns to the process of step S4. If an operation signal corresponding to the enter button is input (step S4 / YES), the second control unit 330 accepts the setting of the source setting screen 400 and transmits image data of the adjusted image 500A to the projector 200. Then, the second control unit 330 causes the projector 200 to display the adjusted image 500A on the projection surface 30 (step S5).

[0077] Next, the second control unit 330 determines whether or not an operation signal corresponding to an operation for changing the display size of the plurality of screens 600 displayed in the adjusted image 500A has been input (step S6). For example, when an operation signal indicating that the decision button has been pressed and held while the cursor 3 is overlapping the screen 600 is input, the second control unit 330 determines that an operation signal corresponding to an operation to change the display size has been input (step S6 / YES).

[0078] While an operation signal of the enlarge button is being input, the second control unit 330 changes the display size of the screen 600 on which the cursor 3 overlaps by a preset setting value (step S7), thereby enlarging the display size of the screen 600. Also, while an operation signal of the reduce button is being input, the second control unit 330 changes the display size of the screen 600 on which the cursor 3 overlaps by a preset setting value (step S7), thereby reducing the display size of the screen 600.

[0079] In addition, if an operation signal corresponding to an operation to change the display size has not been input (step S6 / NO), the second control unit 330 determines whether or not an operation signal corresponding to an operation to change the display position of the screen 600 has been input (step S8). For example, when an operation signal indicating that the decision button has been pressed briefly while the cursor 3 is overlapping the screen 600 is input, the second control unit 330 determines that an operation to change the display position has been input (step S8 / YES).

[0080] The second control unit 330 displays an arrow image 510 shown in Fig. 5 around the screen 600 whose display position is to be changed. When an operation signal indicating that the cross key has been operated is input, the second control unit 330 changes the display position of the target screen 600 (step S9). The second control unit 330 moves the display position of the screen 600 in the direction corresponding to the operated cross key.

[0081] Furthermore, if an operation signal corresponding to an operation to change the display size is not input (step S8 / NO), the second control unit 330 determines whether or not an operation signal corresponding to the decision button is input (step S10). The operation signal corresponding to the decision button is a signal output from the remote control light receiving unit 310 to the second control unit 330 when the decision button is pressed. If an operation signal corresponding to the decision button has not been input (step S10 / NO), the second control unit 330 returns to the determination in step S6.

[0082] When an operation signal corresponding to the decision button is input (step S10 / YES), the second control unit 330 generates output information (step S11). The output information includes an output image 500B and source information. The second control unit 330 generates an output image 500B in which the display color of a screen 600 that displays an image of image data input to the input I / F of the projector 200 is changed to black. In addition, the source information is set based on the source setting received on the source setting screen 400.

[0083] Next, the second control unit 330 transmits the generated output information to the projector 200 via the USB I / F 303 (step S12). In addition, the second control unit 330 may transmit the output image 500B to the projector 200 via the HDMI I / F 301, and transmit the source information to the projector 200 via the USB I / F 303.

[0084] FIG. 9 is a flowchart showing the operation of the projector 200. The operation of the projector 200 will be described with reference to the flowchart shown in FIG. First, the first control unit 270 determines whether or not image data of the output image 500B has been received (step T1). If the image data of the output image 500B has not been received (step T1 / NO), the first control unit 270 waits until the image data of the output image 500B is received.

[0085] When the first control unit 270 receives the image data of the output image 500B (step T1 / YES), it judges whether or not the source information has been received (step T2). If the first control unit 270 has not received the source information (step T2 / NO), it causes the image processing unit 240 to process the image data of the output image 500B. If the image I / F 210 is not included in the sources set on the source setting screen 400, the control device 300 does not transmit the source information to the projector 200. That is, in order to display the APP image generated by the APP 350 of the control device 300, the source information is not transmitted to the projector 200.

[0086] The image processing unit 240 loads the received image data in the frame memory 245, and performs image processing on the loaded image, such as adjusting the color tone and brightness of the image. After that, the image processing unit 240 outputs image information, which is information on the image loaded in the frame memory 245, to the image projection unit 250. The image projection unit 250 generates image light corresponding to the image information (step T8), and projects the generated image light onto the projection surface 30 by the projection lens 255 (step T9). As a result, the output image 500B is displayed on the projection surface 30 as a display image 500C.

[0087] Furthermore, if the source information has been received (step T2 / YES), the first control unit 270 determines whether the input I / F indicated by the source information has received image data (step T3). If the input I / F has not received image data (step T3 / NO), the first control unit 270 waits until the input I / F receives image data.

[0088] When the input I / F indicated by the source information receives image data (step T3 / YES), the first control unit 270 detects a black image area from within the area of ​​the output image 500B (step T4). Next, first control unit 270 determines whether or not the resolution of the detected black image area matches the resolution of the image data (step T5).

[0089] If the resolution of the detected black image area does not match the resolution of the image data (step T5 / NO), the first control unit 270 causes the image processing unit 240 to execute a resolution conversion process to match the resolution of the image data to the resolution of the black image area (step T6).

[0090] Furthermore, if the resolution of the detected black image area matches the resolution of the image data (step T5 / YES), the image processing unit 240 superimposes the image data on the black image area of ​​the output image 500B to generate a display image 500C (step T7). Then, the image processing unit 240 outputs image information based on the image data expanded in the frame memory 245 to the image projection unit 250. The image projection unit 250 generates image light corresponding to the image information (step T8) and projects the generated image light onto the projection surface 30 by the projection lens 255 (step T9). As a result, the display image 500C is displayed on the projection surface 30.

[0091] 5. Other embodiments The above-described embodiment is a preferred embodiment, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit and scope of the present invention. For example, the projector 200 may transmit information indicating whether image data has been received from the image supply device 100 via the first HDMI I / F 211 to the projector 200 via the first USB I / F 221. If the information received from the projector 200 indicates that the projector 200 is not receiving image data from the image supply device 100, the control device 300 does not transmit the output image 500B including the black third screen 650 and the source information to the projector 200. Furthermore, when the control device 300 is configured to transmit output information including the adjusted image 500A, the screen information, and the source information to the projector 200, the control device 300 does not transmit the screen information and the source information to the projector 200.

[0092] For example, in the above embodiment, the light modulation device includes three transmissive liquid crystal panels 253(R), 253(G), and 253(B), but the embodiment of the present invention is not limited to this. The light modulation device may be a reflective liquid crystal panel or a digital micromirror device.

[0093] 1 and 2 show functional configurations, and the specific implementation form is not particularly limited. In other words, it is not necessary to implement hardware that corresponds to each functional unit individually, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Also, some of the functions realized by software in the above embodiments may be realized by hardware, or some of the functions realized by hardware may be realized by software.

[0094] Furthermore, when the control method for the display system is realized using a computer included in the control device 300 and the projector 200, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specifically, portable or fixed recording media such as a flexible disk, HDD (Hard Disk Drive), CD-ROM, DVD, Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording medium can be used. The recording medium can also be a non-volatile storage device such as RAM, ROM, and HDD, which are internal storage devices included in the server device.

[0095] 6. Summary of this Disclosure The following is a summary of this disclosure.

[0096] (Appendix 1) A control method for a display system, comprising: a control device transmitting output information to a display device, the output information including an output image in which a first image is placed and position information indicating a position of the output image in which a second image is to be placed; an image supply device transmitting the second image to the display device; the display device generating a display image by placing the second image on the output image based on the position information; and the display device displaying the display image.

[0097] As a result, the display device generates a display image by arranging the second image in the output image according to the position information received from the control device, and the generated display image is displayed by the display device. As a result, the display device can generate a display image in which the first image and the second image are arranged according to the position information, and display the generated display image. Therefore, a display image in which multiple images are arranged can be displayed by the display device without increasing the processing power of the display device.

[0098] (Appendix 2) The position information is information indicating an area of ​​a preset color in the output image, and generating the display image includes the display device detecting an area of ​​the preset color from the output image and placing the second image in the area.

[0099] In this way, by forming the area of ​​the output image in which the second image is to be placed in a preset color, the display device can detect the area of ​​the preset color from the output image and place the second image in the detected area of ​​the output image to generate a display image, thereby eliminating the need to generate position information separately.

[0100] (Appendix 3) 2. The method for controlling a display system according to claim 1, wherein the position information is information indicating a position and a size in the output image.

[0101] This enables the display device to generate a display image by arranging the second image in the output image based on the position and size indicated by the position information.

[0102] (Appendix 4) The method for controlling a display system according to any one of claims 1 to 3, wherein the first image is an image generated by the control device executing an application program.

[0103] In this way, the image generated by executing the application program is included in the display image as the first image, and therefore the image generated by executing the application program can be displayed.

[0104] (Appendix 5) A control method for a display system described in any one of Appendix 1 to 3, further comprising the control device receiving an operation specifying a position of the output image at which the second image is to be placed, and generating the position information based on the received operation.

[0105] This allows the second image to be placed at the position of the output image designated by the user by performing an operation to designate the position of the output image. Therefore, the second image can be placed at the position of the output image designated by the user.

[0106] (Appendix 6) A control method for a display system described in any one of Appendix 1 to 3, wherein the display device and the control device are connected by a first interface, and the control device transmitting the output information to the display device means that the control device transmits the output information to the display device via the first interface, and the display device and the image supply device are connected by a second interface different from the first interface, and the image supply device transmitting the second image to the display device means that the image supply device transmits the second image to the display device via the second interface.

[0107] As a result, the output information is transmitted from the control device to the display device via the first interface, and the second image is transmitted from the image supply device to the display device via the second interface, thereby reducing delays in transmitting the output information and the second image to the display device.

[0108] (Appendix 7) A control method for a display system described in any one of Appendix 1 to 3, wherein the display device transmits information to the control device indicating whether or not the second image has been received from the image supply device, and the control device transmits the output information not including the position information to the display device if the display device has not received the second image from the image supply device.

[0109] In this way, when the display device does not receive the second image from the image supply device, the control device transmits output information that does not include position information to the display device, thereby making it possible to prevent transmission of unnecessary information that is not used by the display device.

[0110] (Appendix 8) A display device including a first interface connecting to a control device, a second interface connecting to an image supply device, an optical device, and at least one processor, wherein the at least one processor executes the following: receiving output information via the first interface, the output information including an output image in which a first image is placed and position information indicating a position on the output image in which a second image is to be placed; receiving the second image via the second interface; generating a display image by placing the second image on the output image based on the position information; and displaying the display image using the optical device.

[0111] According to this configuration, a display image is generated by arranging the second image in the output image according to the position information received via the first interface, and the generated display image is displayed. This allows the display device to generate a display image in which the first image and the second image are arranged according to the position information, and display the generated display image. Therefore, the display image in which multiple images are arranged can be displayed by the display device without increasing the processing power of the display device.

[0112] (Appendix 9) A control device including at least one processor, the at least one processor executing the following: generating output information including an output image in which a first image is positioned and position information indicating a position in the output image in which a second image is to be positioned; and transmitting the output information to a display device.

[0113] According to this configuration, output information including an output image in which the first image is arranged and position information indicating a position in the output image in which the second image is arranged is transmitted to the display device, so that the display device can generate a display image by arranging the second image at the position in the output image indicated by the position information, and display the generated display image. [Explanation of symbols]

[0114] 1...display system, 3...cursor, 5...cable, 7...cable, 30...projection surface, 100...image supply device, 200...projector, 210...HDMII / F, 211...first HDMII / F, 213...second HDMII / F, 215...third HDMII / F, 220...USBI / F, 221...first USBI / F, 223...second USBI / F, 240...image processing unit, 245...frame memory, 250...image projection unit, 251...light source, 253...liquid crystal panel, 254...image forming area, 255...projection lens, 257...panel drive unit, 270...first control unit, 280...first storage unit, 285...control program, 290...first processor, 300...control device, 301...HDMII / F, 303...USBI / F, 310... remote control receiver, 320... remote control, 330... second control unit, 340... second storage unit, 341... OS, 350... APP, 360... second processor, 400... source setting screen, 410... source list, 430... setting field, 450... first screen setting field, 455... toggle button, 470... second screen setting field, 475... toggle button, 490... third Screen setting column, 495...toggle button, 500A...adjustment image, 500B...output image, 500C...display image, 510...arrow image, 511...arrow image, 513...arrow image, 515...arrow image, 517...arrow image, 600...screen, 610...first screen, 630...second screen, 650...third screen, 651...top edge, 651...right edge, 653...bottom edge, 655...left edge.

Claims

1. The control device transmits output information to the display device, the output information including an output image in which the first image is arranged and position information indicating a position of the output image in which the second image is arranged; an image providing device transmitting the second image to the display device; generating a display image by positioning the second image in the output image based on the position information; and the display device displays the display image; and A method for controlling a display system comprising:

2. the position information is information indicating an area of ​​a preset color in the output image, generating the display image The display device, detecting an area of ​​the preset color from the output image; and placing the second image in the region. A method for controlling the display system according to claim 1.

3. The position information is information indicating a position and a size in the output image. A method for controlling the display system according to claim 1.

4. The first image is an image generated by the control device executing an application program. A method for controlling a display system according to any one of claims 1 to 3.

5. The control device, receiving an operation to designate a position on the output image in which the second image is to be placed; generating the position information based on the received operation; The method for controlling a display system according to claim 1 , further comprising:

6. The display device and the control device are connected by a first interface, the control device transmitting the output information to the display device means that the control device transmits the output information to the display device via the first interface; the display device and the image supply device are connected by a second interface different from the first interface, the image supply device transmitting the second image to the display device is the image supply device transmitting the second image to the display device via the second interface; A method for controlling a display system according to any one of claims 1 to 3.

7. The display device transmits information indicating whether the second image has been received from the image supply device to the control device; the control device transmits, to the display device, the output information not including the position information when the display device has not received the second image from the image supply device; A method for controlling a display system according to any one of claims 1 to 3.

8. a first interface for connecting to a control device; a second interface for connecting to an image source device; An optical device; at least one processor; The at least one processor receiving output information via a first interface, the output information including an output image in which a first image is arranged and position information indicating a position of the output image in which a second image is arranged; receiving the second image via a second interface; generating a display image by positioning the second image in the output image based on the position information; displaying the display image using the optical device; A display device that performs the above.

9. at least one processor; The at least one processor generating output information including an output image in which the first image is arranged and position information indicating a position in the output image in which the second image is arranged; transmitting the output information to a display device; A control device that executes the above.

Images