Display system and control method of display system

JP2023077506A5Active Publication Date: 2024-11-08SEIKO EPSON CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2021190796
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-11-25
Publication Date
2024-11-08
Estimated Expiration
2041-11-25

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

To reduce a burden on a user in adjustment of a projection image.SOLUTION: A control method of a display system 1000 comprises the steps of: causing a projector 1 to display a first UI related to adjustment of a projection image G; causing a control device 2 to display a second UI related to adjustment of the projection image G and including a fifth display object OB5; causing the projector 1 to transmit first adjustment information based on a first operation to the first UI to the control device 2; causing the projector 1 to adjust the projection image G on the basis of the first adjustment information; causing the control device 2 to update the fifth display object OB5 on the basis of the first adjustment information; causing the control device 2 to transmit second adjustment information based on a second operation to the second UI to the projector 1; causing the projector 1 to adjust the projection image on the basis of the second adjustment information; and causing the projector 1 to update the first UI on the basis of the second adjustment information.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a display system and a method for controlling the display system.

Background Art

[0002] Conventionally, a system having a projection device and a control device that communicates with the projection device and transmits and receives information between the projection device and the control device is known. Patent Document 1 discloses that any one of a plurality of computers transmits operation information for operating a projection screen projected from a projector to the projector. Patent Document 1 also discloses that the projector performs screen control of the projection screen according to the received operation information and transmits control information indicating the control result of the screen control to the plurality of computers.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a system as described in Patent Document 1, in adjusting a projection image, there is a system in which a control device displays an adjustment screen. In this type of system, after the user performs an adjustment operation on the adjustment screen, it is necessary to confirm the adjustment result by the adjustment operation in the projection image. Therefore, in this type of system, there may be a lot of user's line-of-sight movement, and there is a problem that the user's load is large in adjusting the projection image.

Means for Solving the Problems

[0005] One aspect of the present disclosure is a method for controlling a display system, comprising: a projection device displaying a first user interface relating to the adjustment of a projected image; a control device communicating with the projection device displaying a second user interface which is a user interface relating to the adjustment of the projected image and includes a display object corresponding to the projected image; when the projection device receives a first operation on the first user interface, transmitting first adjustment information based on the first operation to the control device; the projection device adjusting the projected image based on the first adjustment information; the control device updating the display object based on the first adjustment information; when the control device receives a second operation on the second user interface, transmitting second adjustment information based on the second operation to the projection device; the projection device adjusting the projected image based on the second adjustment information; and the projection device updating the first user interface based on the second adjustment information.

[0006] Another aspect of the present disclosure is a display system comprising a projection device and a control device communicating with the projection device, wherein the projection device displays a first user interface relating to the adjustment of a projected image; the control device communicating with the projection device displays a second user interface relating to the adjustment of the projected image, which is a user interface including display objects corresponding to the projected image; the projection device, upon receiving a first operation on the first user interface, transmits first adjustment information based on the first operation to the control device; the projection device adjusts the projected image based on the first adjustment information; the control device updates the display objects based on the first adjustment information; the control device, upon receiving a second operation on the second user interface, transmits second adjustment information based on the second operation to the projection device; the projection device adjusts the projected image based on the second adjustment information; and the projection device updates the first user interface based on the second adjustment information. [Brief explanation of the drawing]

[0007] [Figure 1] A diagram showing an example of the display system configuration. [Figure 2] A diagram showing an example of the configuration of a projector and control device. [Figure 3] A diagram showing an example of the first UI. [Figure 4] A diagram showing an example of the second UI. [Figure 5] A flowchart illustrating the operation of the display system. [Figure 6] A flowchart illustrating the operation of the display system. [Figure 7] A diagram showing an example of the first UI. [Figure 8] A diagram showing an example of the second UI. [Figure 9] A flowchart illustrating the operation of the display system. [Figure 10] A diagram showing an example of the first UI. [Figure 11] A diagram showing an example of the second UI. [Modes for carrying out the invention]

[0008] The embodiments will be described below with reference to the drawings. Figure 1 shows an example of the configuration of the display system 1000. Figure 1 illustrates the X, Y, and Z axes. The X, Y, and Z axes are orthogonal to each other. The Z axis indicates the vertical direction. The X and Y axes are parallel to the horizontal direction. The X axis indicates the left-right direction. The Y axis indicates the front-back direction. The positive direction of the Z axis is upward. The positive direction of the X axis is to the right. The positive direction of the Y axis is forward. Note that the X, Y, and Z axes illustrated in Figures 3, 7, and 10 are in the same direction as the X, Y, and Z axes in Figure 1.

[0009] Figure 1 shows the configuration of the display system 1000. The display system 1000 of this embodiment includes a plurality of projectors 1 installed side by side. The display system 1000 performs tiling display by displaying a plurality of projected images G side by side using these plurality of projectors 1.

[0010] As shown in Figure 1, the display system 1000 of this embodiment includes two projectors 1, projectors 1A and 1B. The two projectors 1 are installed in one vertical row and two horizontal columns. Projector 1 is an example of a "projection device".

[0011] Note that Figure 1 shows that the number of projectors 1 in the display system 1000 is not limited to two, but may be one or three or more. Furthermore, the multiple projectors 1 can be arranged in an N x M grid, where N and M are integers of 1 or greater.

[0012] The projector 1 projects an image light based on image data input from the control device 2 or an image supply device separate from the control device 2, and displays a projection image G on a screen SC as a projection surface. The screen SC may be a curtain-like screen, or the wall surface of a building or the flat surface of a fixture may be used as the screen SC. The screen SC is not limited to a flat surface, and may be a curved surface or a surface with irregularities.

[0013] The display mode of the projection image G shown in FIG. 1 shows the display mode after the adjustment of the projection image G has been appropriately executed. In FIG. 1, the projector 1A displays a projection image G1 that overlaps with the edge of the projection image G2 on the screen SC. In FIG. 1, the projector 1B displays a projection image G2 that overlaps with the edge of the projection image G1 on the screen SC.

[0014] Each of the projectors 1A and 1B is connected to the network NW. The network NW is a network composed of communication facilities such as a public line network, a dedicated line, or other communication lines, and the specific mode is not limited. For example, the network NW may be a wide area network or a local area network. The network NW may include at least one of a wireless communication circuit and a wired communication circuit.

[0015] As shown in FIG. 1, the display system 1000 includes a control device 2. The control device 2 is connected to the network NW. The control device 2 shown in FIG. 1 is a notebook PC (Personal Computer). Note that the control device 2 is not limited to a notebook-type PC, and may be a device such as a desktop PC, a tablet terminal, or a smartphone. The control device 2 controls the projector 1. When the control device 2 functions as an image supply device, one frame of image data is divided into two, and each of the divided image data is output to each of the projectors 1A and 1B.

[0016] FIG. 2 is a block diagram showing the configurations of the projector 1 and the control device 2.

[0017] Projector 1 includes a first control unit 10. The first control unit 10 includes a first processor 110 that executes programs such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and a first memory 120, and controls each part of the projector 1. The first control unit 10 allows the first processor 110 to read the control program 121 stored in the first memory 120 and execute processing. By reading and executing the control program 121, the first processor 110 functions as a projection control unit 111, a UI (user interface) processing unit 112, an adjustment information generation unit 113, a transmission unit 114, a reception unit 115, and a receiving unit 116.

[0018] The first memory 120 is a memory that stores programs executed by the first processor 110 and data processed by the first processor 110. The first memory 120 has a non-volatile storage area for storing programs and data non-volatilely. The first memory 120 may also have a volatile storage area and constitute a work area for temporarily storing programs executed by the first processor 110 and data to be processed.

[0019] The first memory 120 stores setting data 122 in addition to the control program 121 executed by the first processor 110. The setting data 122 includes setting values ​​related to the operation of the projector 1. Examples of setting values ​​included in the setting data 122 include setting values ​​indicating the processing content executed by the image processing unit 14, parameters used in the processing of the image processing unit 14, parameters indicating the lens position of the projection lens 164, and parameters indicating the zoom magnification. In the following explanation, the parameter indicating the lens position of the projection lens 164 is referred to as the "lens position parameter." Similarly, the parameter indicating the zoom magnification is referred to as the "zoom magnification parameter."

[0020] Projector 1 comprises a first interface 11, a second interface 12, a frame memory 13, an image processing unit 14, and an operation unit 15. Each of these units is connected to the first control unit 10 via a bus 19 for data communication.

[0021] The first interface 11 includes communication hardware such as connectors and interface circuits compliant with a predetermined communication standard. The first interface 11 transmits and receives image data, control data, etc., to and from devices connected to the projector 1 in accordance with the predetermined communication standard, under the control of the first control unit 10. The first interface 11 may include interfaces capable of digitally transmitting video and audio, such as HDMI (High-Definition Multimedia Interface), DisplayPort, HDBaseT, USB Type-C, and 3G-SDI (Serial Digital Interface). HDMI is a registered trademark. HDBaseT is a registered trademark. The first interface 11 may also include interfaces for data communication, such as USB. Furthermore, the first interface 11 may include interfaces capable of transmitting and receiving analog video signals, such as RCA terminals, VGA terminals, S-video terminals, and D-video terminals.

[0022] The second interface 12 includes communication hardware such as connectors and interface circuits connected to the network NW. The second interface 12 communicates with the control device 2, which is connected via the network NW, according to a predetermined communication standard.

[0023] The frame memory 13 and the image processing unit 14 are composed of, for example, integrated circuits. Integrated circuits include LSIs, ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), FPGAs (Field-Programmable Gate Arrays), SoCs (System-on-a-chip), etc. Furthermore, analog circuits may be included as part of the configuration of the integrated circuit, and the first control unit 10 may be combined with an integrated circuit.

[0024] The frame memory 13 comprises multiple banks. Each bank has a storage capacity capable of writing one frame. The frame memory 13 is composed of, for example, SDRAM (Synchronous Dynamic Random Access Memory).

[0025] The image processing unit 14 performs image processing on the image data expanded in the frame memory 13, such as resolution conversion or resizing, distortion correction, shape correction, digital zoom, and adjustment of image hue and brightness. The image processing unit 14 executes the processing specified by the first control unit 10 and, if necessary, uses parameters input from the first control unit 10. The image processing unit 14 can also combine and execute multiple of the above image processing operations. The image processing unit 14 reads the processed image data from the frame memory 13 and outputs it to the optical modulator drive circuit 172.

[0026] The control unit 15 includes an operation panel 151 and a remote control receiver 152.

[0027] The control panel 151 is, for example, mounted on the housing of the projector 1 and includes various switches such as a power switch for turning the power of the projector 1 on and off. When a switch is operated, the control panel 151 outputs a signal corresponding to the operated switch to the first control unit 10. The remote control receiver 152 includes a light receiving sensor that receives infrared signals transmitted by the remote control 3, and a circuit that decodes the infrared signals received by the light receiving sensor. The remote control receiver 152 outputs a signal corresponding to the infrared signal received by the light receiving sensor to the first control unit 10. The signal that the remote control receiver 152 outputs to the first control unit 10 is a signal corresponding to the switch on the remote control 3 that was operated.

[0028] The projector 1 comprises a projection unit 16 and a drive unit 17 that drives the projection unit 16. The projection unit 16 includes a light source 161, a light modulator 162, and a projection optical system 163. The drive unit 17 includes a light source drive circuit 171, a light modulator drive circuit 172, and a projection optical system drive circuit 173.

[0029] The light source drive circuit 171 is connected to the first control unit 10 via the bus 19 and is also connected to the light source 161. The light source drive circuit 171 turns the light source 161 on or off according to the control of the first control unit 10.

[0030] The optical modulator drive circuit 172 is connected to the first control unit 10 via the bus 19, and the optical modulator 162 is also connected to it. The optical modulator drive circuit 172 drives the optical modulator 162 according to the control of the first control unit 10 and draws images frame by frame on the optical modulation elements of the optical modulator 162. The optical modulator drive circuit 172 receives image data corresponding to each of the RGB primary colors from the image processing unit 14. R represents red, G represents green, and B represents blue. The optical modulator drive circuit 172 converts the input image data into data signals suitable for the operation of the liquid crystal panels, which are the optical modulation elements of the optical modulator 162. Based on the converted data signals, the optical modulator drive circuit 172 applies a voltage to each pixel of each liquid crystal panel and draws an image on each liquid crystal panel.

[0031] The light source 161 consists of lamps such as halogen lamps, xenon lamps, and ultra-high pressure mercury lamps, or solid-state light sources such as LEDs and laser light sources. The light source 161 is lit by power supplied from the light source drive circuit 171 and emits light toward the light modulation device 162.

[0032] The optical modulator 162 comprises, for example, three liquid crystal panels corresponding to the three primary colors of RGB. Light emitted from the light source 161 is separated into three colored lights of RGB and incident on the corresponding liquid crystal panels. Each of the three liquid crystal panels is a transmissive liquid crystal panel, and modulates the transmitted light to generate image light. The modulated image light that has passed through each liquid crystal panel is combined by a composite optical system such as a cross dichroic prism and projected onto the projection optical system 163. In this embodiment, the optical modulator 162 is exemplified as having a transmissive liquid crystal panel as the optical modulator element, but the optical modulator element may also be a reflective liquid crystal panel or a digital micromirror device.

[0033] The projection optical system 163 includes a projection lens 164 that forms an image of the image light modulated by the light modulator 162 onto the screen SC. The projection lens 164 in this embodiment is a zoom lens that projects the image light modulated by the light modulator 162 at a desired magnification. The projection optical system 163 also includes a zoom mechanism for enlarging or reducing the projected image G projected onto the screen SC, and a focus adjustment mechanism for adjusting the focus.

[0034] A projection optical system drive circuit 173 is connected to the projection optical system 163. The projection optical system drive circuit 173 is connected to the bus 19. The projection optical system drive circuit 173 moves the projection lens 164 in a plane perpendicular to the optical axis according to the control of the first control unit 10, and performs lens shift adjustment to move the projected image G projected onto the screen SC in the X-axis and Z-axis directions.

[0035] As described above, the first processor 110 functions as a projection control unit 111, a UI processing unit 112, an adjustment information generation unit 113, a transmission unit 114, a reception unit 115, and a receiving unit 116.

[0036] The projection control unit 111 controls the image processing unit 14, the drive unit 17, etc., to display the projected image G on the screen SC.

[0037] Specifically, the projection control unit 111 controls the image processing unit 14 to process the image data expanded in the frame memory 13. At this time, the projection control unit 111 reads the parameters necessary for processing from the first memory 120 and outputs them to the image processing unit 14.

[0038] The projection control unit 111 controls the light source drive circuit 171 and the light modulator drive circuit 172 to turn on the light source 161 with the light source drive circuit 171 and drive the light modulator 162 with the light modulator drive circuit 172, thereby displaying the projected image G on the projection unit 16. The projection control unit 111 also controls the projection optical system 163 to start the motor and adjust the zoom and focus of the projection optical system 163. Furthermore, the projection control unit 111 reads the lens position parameter from the setting data 122 and controls the projection optical system drive circuit 173 based on the read lens position parameter to move the projection lens 164 to the lens position indicated by the lens position parameter. The lens position parameter includes a parameter indicating the lens position of the projection lens 164 in the vertical direction and a parameter indicating the lens position of the projection lens 164 in the horizontal direction.

[0039] The UI processing unit 112 generates image data for the first UI 1121. The first UI 1121 is a UI related to adjusting the projected image G. After generating the image data for the first UI 1121, the UI processing unit 112 expands the generated image data of the first UI 1121 into the frame memory 13. The UI processing unit 112 may either superimpose the image data of the first UI 1121 onto the image data already expanded in the frame memory 13, or overwrite it with the image data of the first UI 1121. The UI processing unit 112 also updates the display content of the first UI 1121.

[0040] Figure 3 shows an example of the first UI1121 projected onto the screen SC.

[0041] The first UI1121 shown in Figure 3 is the first UI1121 for lens shift adjustment. The first UI1121 for lens shift adjustment has a first display object OB1 and a second display object OB2 superimposed on the first display object OB1.

[0042] The second display object OB2 is an image that shows the positional relationship between the lens-shiftable region and the projected image G. The lens-shiftable region is the area in which the projected image G can be moved by adjusting the lens shift. The second display object OB2 includes the third display object OB3 and the fourth display object OB4 superimposed on the third display object OB3. The third display object OB3 is an image that shows the lens-shiftable region. The lens-shiftable region shown by the third display object OB3 has scales that extend vertically and scales that extend horizontally. The fourth display object OB4 is an image that shows the size of the projected image G and the position of the projected image G within the lens-shiftable region.

[0043] The first display object OB1 is an enlarged image of the fourth display object OB4 superimposed on the third display object OB3. The size of the first display object OB1 projected onto screen SC is the same as the size of the projection area onto which the projected image G is projected.

[0044] When the projector 1 starts displaying the first UI 1121, the UI processing unit 112 obtains the lens position parameter and the zoom magnification parameter from the setting data 122. Next, based on these obtained parameters, the UI processing unit 112 recognizes the size of the projected image G relative to the lens shiftable region and the position of the projected image G within the lens shiftable region, and generates a second display object OB2 based on the recognition result. After generating the second display object OB2, the UI processing unit 112 generates a first display object OB1, which is an enlarged version of the fourth display object OB4 indicated by the generated second display object OB2. After generating the first display object OB1 and the second display object OB2, the UI processing unit 112 generates the first UI 1121 by superimposing the second display object OB2 on the upper left of the first display object OB1. Then, the UI processing unit 112 expands the image data of the generated first UI 1121 into the frame memory 13.

[0045] Returning to the description of the functional parts of the first processor 110, the adjustment information generation unit 113 generates first adjustment information. The adjustment information generation unit 113 outputs the generated first adjustment information to the transmission unit 114. The first adjustment information is information indicating the adjustment of the projected image G by the first operation received by the reception unit 116. The first operation is an operation on the first UI 1121 and is an operation to adjust the projected image G. For example, if the adjustment of the projected image G is a lens shift adjustment, the first adjustment information includes information indicating the direction in which the projected image G moved and information indicating the amount of movement of the projected image G. Also, for example, if the adjustment of the projected image G is an adjustment of the zoom magnification, the first adjustment information is information indicating the zoom magnification after adjustment.

[0046] The transmitting unit 114 transmits the first adjustment information to the control device 2 via the second interface 12. The address of the control device 2 is pre-stored in the first memory 120.

[0047] The receiving unit 115 receives second adjustment information from the control device 2 via the second interface 12. The second adjustment information will be described later.

[0048] The reception unit 116 receives user operations on the projector 1. The reception unit 116 receives operations on various switches provided on the housing of the projector 1 via the operation panel 151. The reception unit 116 also receives operations on various switches provided on the remote control 3 via the remote control receiver 152. In this embodiment, the reception unit 116 receives the first operation via the operation panel 151 or the remote control receiver 152.

[0049] Next, the configuration of the control device 2 will be described. The control device 2 comprises a second control unit 20, a communication unit 21, an input unit 22, and a display unit 23.

[0050] The second control unit 20 includes a second processor 210 that executes programs such as CPU and MPU, and a second memory 220. The second control unit 20 controls each part of the control device 2 by having the second processor 210 read and execute a control program 221 stored in the second memory 220. The second processor 210 functions as an application execution unit 211 by reading and executing an adjustment application 222 stored in the second memory 220.

[0051] The second memory 220 stores programs executed by the second processor 210 and data processed by the second processor 210. The second memory 220 stores control programs 221, adjustment applications 222, and various other data executed by the second processor 210. The second memory 220 has a non-volatile storage area. Alternatively, the second memory 220 may also have a volatile storage area and constitute the work area of ​​the second processor 210.

[0052] The adjustment application 222 is an application program related to the adjustment of the projected image G.

[0053] The communication unit 21 is a communication interface equipped with communication circuits, connectors, etc., and communicates with the projector 1 connected to the network NW according to a predetermined communication standard. The communication standard of the communication unit 21 may be either a wireless communication standard or a wired communication standard.

[0054] The input unit 22 has input devices such as operation switches, touch input panels, mice, and keyboards provided on the control device 2, and detects user operations on the input devices and outputs the detection results to the second control unit 20. The second control unit 20 executes processing corresponding to the operations on the input devices based on the input from the input unit 22.

[0055] The display unit 23 is equipped with a display and displays information on the display according to the control of the second control unit 20.

[0056] As described above, the second processor 210 functions as an application execution unit 211. The application execution unit 211 communicates with the projector 1 via the communication unit 21. The application execution unit 211 displays the second UI 2211. The application execution unit 211 also updates the content displayed on the second UI 2211.

[0057] Figure 4 shows an example of the second UI2211. The second UI2211 shown in Figure 4 is the second UI2211 for lens shift adjustment. The second UI2211 for lens shift adjustment has a fifth display object OB5. The fifth display object OB5 is an example of a "display object".

[0058] The fifth display object OB5 is an image showing the positional relationship between the lens-shiftable region and the projected image G. The fifth display object OB5 includes the sixth display object OB6 and the seventh display object OB7 superimposed on the sixth display object OB6. The sixth display object OB6 is an image showing the lens-shiftable region. The lens-shiftable region shown by the sixth display object OB6 may have a scale set, similar to the third display object OB3. The seventh display object OB7 is an image showing the size of the projected image G and the position of the projected image G within the lens-shiftable region.

[0059] When the application execution unit 211 starts displaying the second UI 2211, it obtains the lens position parameter and the zoom magnification parameter from the projector 1. Then, based on these obtained parameters, the application execution unit 211 recognizes the size of the projected image G and the position of the projected image G within the lens shiftable region, and generates the fifth display object OB5 based on the recognition result.

[0060] The second UI2211 has buttons B1, B2, B3, and B4. Buttons B1, B2, B3, and B4 are software buttons. Button B1 moves the projected image G upwards. Button B2 moves the projected image G to the right. Button B3 moves the projected image G downwards. Button B4 moves the projected image G to the left.

[0061] The application execution unit 211 generates second adjustment information and transmits the generated second adjustment information to the projector 1. The second adjustment information is information indicating the adjustment of the projected image G by the second operation received by the application execution unit 211. The second operation is an operation on the second UI 2211 and is an operation to adjust the projected image G. The application execution unit 211 receives the second operation via at least one of the buttons B1, B2, B3, or B4. The second adjustment information includes, for example, information indicating the direction in which to move the projected image G and information indicating the amount by which to move the projected image G, if the adjustment of the projected image G is a lens shift adjustment. The second adjustment information also includes, for example, information indicating the zoom magnification to be adjusted, if the adjustment of the projected image G is a zoom magnification adjustment.

[0062] Next, the operation of the display system 1000 will be described. Figure 5 is a flowchart showing the operation of the display system 1000. In Figure 5, flowchart FA shows the operation of the control device 2, and flowchart FB shows the operation of the projector 1. In the operation shown in Figure 5, lens shift adjustment is used as an example of adjusting the projected image G.

[0063] As shown in flowchart FA, the application execution unit 211 determines whether or not it has received a command from the user to start lens shift adjustment (step SA1).

[0064] If the application execution unit 211 determines that it has not received a command from the user to start lens shift adjustment (step SA1: NO), it performs the determination in step SA1 again.

[0065] On the other hand, if the application execution unit 211 determines that it has received an instruction from the user to start lens shift adjustment (step SA1: YES), it sends adjustment start information to the projector 1 to be adjusted, indicating that an instruction to start lens shift adjustment has been received (step SA2).

[0066] As shown in the flowchart FB, the receiving unit 115 receives adjustment start information (step SB1).

[0067] Next, the transmitting unit 114 obtains the lens position parameter and the zoom magnification parameter from the setting data 122 (step SB2).

[0068] Next, the transmitting unit 114 transmits the two types of parameters acquired in step SB2 to the control device 2 (step SB3).

[0069] Next, the UI processing unit 112 generates the first UI 1121 (step SB4).

[0070] Next, the projection control unit 111 displays the first UI1121 generated in step SB4 on the screen SC (step SB5).

[0071] As shown in the flowchart FB, the application execution unit 211 receives two types of parameters from the projector 1 (step SA3).

[0072] Next, the application execution unit 211 generates the second UI 2211 (step SA4).

[0073] Next, the application execution unit 211 displays the second UI 2211 generated in step SA4 on the screen SC (step SA5).

[0074] Next, we will describe the operation of the display system 1000 when the projected image G is adjusted by the first UI 1121.

[0075] Figure 6 is a flowchart showing the operation of the display system 1000. In Figure 6, flowchart FC shows the operation of control device 2, and flowchart FD shows the operation of projector 1. In the operation shown in Figure 6, projector 1 is displaying the first UI1121, and control device 2 is displaying the second UI2211. In the operation shown in Figure 6, lens shift adjustment is used as an example of adjusting the projected image G.

[0076] As shown in flowchart FD, the reception unit 116 determines whether or not the first operation has been received (step SD1). In the operation shown in Figure 6, the first operation is an operation on the first UI1121 for lens shift adjustment, which is an operation to move the projected image G.

[0077] If the reception unit 116 determines that it has not received the first operation (step SD1: NO), it performs the determination in step SD1 again.

[0078] If the reception unit 116 determines that it has received the first operation (step SD1: YES), the projection control unit 111 controls the projection optical system drive circuit 173 to adjust the position of the projected image G in accordance with the received first operation (step SD2).

[0079] Next, the UI processing unit 112 updates the first UI 1121 displayed by the projector 1 to the first UI 1121 corresponding to the adjustment made in step SD2 (step SD3).

[0080] Figure 7 shows an example of the first UI1121 projected onto the screen SC. Figure 7 shows the case where the first operation is to move the projected image G to the right by a distance of 1. In the case of Figure 7, the UI processing unit 112 updates the displayed second display object OB2 to the next second display object OB2. That is, the UI processing unit 112 updates the fourth display object OB4 to the second display object OB2, which has been moved to the right by a distance corresponding to the first distance, within the lens shiftable region indicated by the third display object OB3. Also in the case of Figure 7, the UI processing unit 112 updates the displayed first display object OB1 to the first display object OB1 which is an enlarged version of the fourth display object OB4 that has been moved to the right.

[0081] Next, the adjustment information generation unit 113 generates first adjustment information (step SD4). In the case of Figure 7, the adjustment information generation unit 113 generates first adjustment information indicating that the direction of movement of the projected image G is to the right and that the amount of movement of the projected image G is a first distance.

[0082] Next, the transmitting unit 114 transmits the first adjustment information generated in step SD4 to the control device 2 (step SD5).

[0083] As shown in flowchart FC, the application execution unit 211 receives the first adjustment information from the projector 1 (step SC1).

[0084] Next, the application execution unit 211 updates the fifth display object OB5 of the second UI 2211 based on the first adjustment information received in step SC1 (step SC2).

[0085] Figure 8 shows an example of the second UI2211. Figure 8 illustrates a case where the received first adjustment information indicates that the direction of movement of the projected image G is to the right, and that the amount of movement of the projected image G is the first distance. As shown in Figure 8, in step SC2, the application execution unit 211 updates the displayed fifth display object OB5 to the next fifth display object OB5. That is, within the lens shiftable region indicated by the sixth display object OB6, the application execution unit 211 updates the seventh display object OB7 to the fifth display object OB5, which has been moved to the right by a distance corresponding to the first distance.

[0086] Next, we will describe the operation of the display system 1000 when the projected image G is adjusted in the second UI2211.

[0087] Figure 9 is a flowchart showing the operation of the display system 1000. In Figure 9, flowchart FE shows the operation of control device 2, and flowchart FF shows the operation of projector 1. In the operation shown in Figure 9, projector 1 is displaying the first UI1121, and control device 2 is displaying the second UI2211.

[0088] As shown in flowchart FE, the application execution unit 211 determines whether or not it has received a second operation (step SE1). The second operation is an operation on the second UI 2211, which adjusts the projected image G. In the operation shown in Figure 9, the second operation is an operation on the second UI 2211 for lens shift adjustment.

[0089] If the application execution unit 211 determines that it has not accepted the second operation (step SE1: NO), it performs the determination in step SE1 again.

[0090] If the application execution unit 211 determines that it has received the second operation (step SE1: YES), it updates the fifth display object OB5 of the second UI 2211 (step SE2).

[0091] Step SE2 will be explained with reference to Figure 8. If the second operation is to move the projected image G to the right by a second distance, the application execution unit 211 updates the fifth display object OB5 as shown in Figure 8. That is, the application execution unit 211 updates the displayed fifth display object OB5 to the fifth display object OB5 obtained by moving the seventh display object OB7 to the right by a distance corresponding to the second distance within the lens shiftable region indicated by the sixth display object OB6.

[0092] Next, the application execution unit 211 generates second adjustment information (step SE3). For example, if the received second operation is to move the projected image G to the right by a second distance, the application execution unit 211 generates second adjustment information indicating that the direction of movement of the projected image G is to the right and that the amount of movement of the projected image G is the second distance.

[0093] Next, the application execution unit 211 transmits the second adjustment information generated in step SE3 to the projector 1 (step SE4).

[0094] As shown in flowchart FF, the receiving unit 115 receives the second adjustment information from the control device 2 (step SF1).

[0095] Next, the UI processing unit 112 updates the first UI 1121 based on the second adjustment information received in step SF1 (step SF2).

[0096] Step SF2 will be explained with reference to Figure 7. If the received second adjustment information indicates that the projected image G should be moved to the right by a second distance, the UI processing unit 112 updates the first UI 1121 in step SF2, as shown in Figure 7. That is, the UI processing unit 112 updates the fourth display object OB4 to the second display object OB2, which has been moved to the right by a distance corresponding to the second distance within the lens shiftable area indicated by the third display object OB3. The UI processing unit 112 also updates the first display object OB1 to the first display object OB1, which has been expanded to include the projection area of ​​the fourth display object OB4, which has been moved to the right by a distance corresponding to the second distance.

[0097] In the explanations of Figures 5, 6, 7, 8, and 9, the case where the adjustment of the projected image G is lens shift adjustment is illustrated as an example. However, the adjustment of the projected image G is not limited to lens shift adjustment; it may also be zoom adjustment, geometric correction adjustment, etc. For adjustments other than lens shift adjustment, the first UI1121 and second UI2211 corresponding to the adjustment other than lens shift adjustment will be displayed.

[0098] Figure 10 shows an example of the first UI1121 involved in zoom adjustment. As is clear from comparing Figure 3 and Figure 10, the first UI1121 related to zoom adjustment includes the second display object OB2, which further includes the eighth display object OB8. The eighth display object OB8 is an image showing the size of the projected image G when the zoom magnification is at its minimum. The center of the eighth display object OB8 coincides with the center of the fourth display object OB4. Therefore, for example, if the fourth display object OB4 is moved by lens shift adjustment, the eighth display object OB8 moves so that its center coincides with the center of the fourth display object OB4.

[0099] Figure 11 shows an example of the second UI2211 involved in zoom adjustment. As is clear from comparing Figure 4 and Figure 11, the second UI2211 related to zoom adjustment includes the fifth display object OB5, which further includes the ninth display object OB9. The ninth display object OB9 is an image showing the size of the projected image G when the zoom magnification is at its minimum. The center of the ninth display object OB9 coincides with the center of the seventh display object OB7. Therefore, for example, if the ninth display object OB9 is moved by lens shift adjustment, the ninth display object OB9 moves so that its center coincides with the center of the seventh display object OB7.

[0100] As described above, the control method for the display system 1000 includes: the projector 1 displaying a first UI 1121 related to the adjustment of the projected image G; the control device 2 communicating with the projector 1 displaying a second UI 2211 which is a UI related to the adjustment of the projected image G and includes a fifth display object OB5 corresponding to the projected image G; when the projector 1 receives a first operation on the first UI 1121, it transmits first adjustment information based on the first operation to the control device 2; the projector 1 adjusts the projected image G based on the first adjustment information; the control device 2 updates the fifth display object OB5 based on the first adjustment information; when the control device 2 receives a second operation on the second UI 2211, it transmits second adjustment information based on the second operation to the projector 1; the projector 1 adjusts the projected image G based on the second adjustment information; and the projector 1 updates the first UI 1121 based on the second adjustment information.

[0101] According to this, the projector 1 and the control device 2 display a UI related to adjusting the projected image G, the fifth display object OB5 is updated in conjunction with the first operation, and the projected image G is adjusted and the first UI 1121 is updated in conjunction with the second operation. Therefore, the projected image G can be adjusted by simply looking at either the projected image G of the projector 1 or the display screen of the control device 2. Thus, the number of times the user needs to compare the projected image G of the projector 1 and the display screen of the control device 2 during the adjustment of the projected image G can be reduced, thereby reducing the burden on the user during the adjustment of the projected image G. Furthermore, because the burden on the user during the adjustment of the projected image G can be reduced, the efficiency of the adjustment work for the projected image G can be increased, and the adjustment time for the projected image G can be shortened.

[0102] When the control device 2 receives an instruction from the projector 1 to start adjusting the projected image G, the projector 1 displays the first UI 1121, and when the control device 2 receives an instruction from the control device 2 to start adjusting the projected image G, the control device 2 displays the second UI 2211.

[0103] According to this, projector 1 can initiate the adjustment of the projected image G.

[0104] When the projector 1 receives an instruction to start adjusting the projected image G, the control device 2 displays the second UI2211, and when the projector 1 receives an instruction to start adjusting the projected image G, the projector 1 displays the first UI1121.

[0105] According to this, the control device 2 can initiate the adjustment of the projected image G.

[0106] The control method for the display control system 1000 includes, when the projector 1 receives a first operation, updating the first UI 1121 based on the first operation, and when the control device 2 receives a second operation, updating the fifth display object OB5 based on the second operation.

[0107] According to this, the first UI1121 is updated in conjunction with the first operation, and the fifth display object OB5 of the second UI2211 is updated in conjunction with the second operation. Therefore, when adjusting the projected image G, the number of times the projected image G of the projector 1 and the display screen of the control device 2 are compared can be reduced, and the burden on the user when adjusting the projected image G can be reduced.

[0108] The adjustment of the projected image G is a lens shift adjustment. The first UI1121 indicates the positional relationship between the lens shiftable region, where the projected image G can be moved by the lens shift adjustment, and the projected image G. The fifth display object OB5 indicates the positional relationship between the lens shiftable region and the projected image G.

[0109] This reduces the burden on the user when adjusting lens shift.

[0110] The display system 1000 includes a projector 1 and a control device 2 that communicates with the projector 1. The projector 1 performs the action of displaying a first UI 1121 related to the adjustment of the projected image G. The control device 2 performs the action of displaying a second UI 2211, which is a UI related to the adjustment of the projected image G and includes a fifth display object OB5 corresponding to the projected image G. When the projector 1 receives a first operation on the first UI 1121, it performs the action of transmitting first adjustment information based on the first operation to the control device 2. The projector 1 performs the action of adjusting the projected image G based on the first adjustment information. The control device 2 performs the action of updating the fifth display object OB5 based on the first adjustment information. When the control device 2 receives a second operation on the second UI 2211, it performs the action of transmitting second adjustment information based on the second operation to the projector 1. The projector 1 performs the action of adjusting the projected image G based on the second adjustment information. Projector 1 performs the action of updating the first UI1121 based on the second adjustment information.

[0111] According to this, it produces the same effect as the display system 1000 described above.

[0112] The embodiments described above are preferred embodiments of the present invention. However, the invention is not limited to these embodiments, and various modifications can be made without departing from the spirit of the invention.

[0113] In the embodiment described above, an example was given in which multiple projectors 1 perform tiling display. However, the display modes performed by multiple projectors 1 are not limited to tiling display. For example, stacking display may be performed, in which multiple projected images G are superimposed to display a projected image G with high brightness.

[0114] Furthermore, the functions of the first processor 110 and the second processor 210 may be realized by multiple processors or semiconductor chips.

[0115] Furthermore, the functional units shown in Figure 2 represent functional configurations and do not limit specific implementation forms. For example, in Projector 1 and Control Device 2, it is not necessarily required that hardware corresponding to each functional unit be implemented individually; it is certainly possible to configure a system where a single processor executes a program to realize the functions of multiple functional units. Also, some of the functions realized by software in each of the above embodiments may be realized by hardware, or vice versa. In addition, the specific detailed configurations of other parts of Projector 1 and Control Device 2 can be arbitrarily changed without departing from the main purpose.

[0116] Furthermore, the operation step units shown in Figures 5, 6, and 9, for example, are divided according to the main processing content in order to facilitate understanding of the operation of the display system 1000, and this disclosure is not limited by the way the processing units are divided or the names of those units. Depending on the processing content, it may be divided into many step units. Alternatively, it may be divided so that one step unit includes many processes. Also, the order of the steps may be changed as appropriate, as long as it does not hinder the intent of this disclosure. [Explanation of symbols]

[0117] 1...Projector (projection device), 1A...Projector (projection device), 1B...Projector (projection device), 2...Control device, 3...Remote control, 10...First control unit, 11...First interface, 12...Second interface, 13...Frame memory, 14...Image processing unit, 15...Operation unit, 16...Projection unit, 17...Drive unit, 19...Bus, 20...Second control unit, 21...Communication unit, 22...Input unit, 110...First processor, 111...Projection control unit, 112...UI processing unit, 113...Adjustment information generation unit, 114...Transmission unit, 115...Receiver unit, 116...Reception unit, 120...First memory, 121...Control program, 12 2...Setting data, 151...Operation panel, 152...Remote control receiver, 161...Light source, 162...Light modulator, 163...Projection optical system, 164...Projection lens, 171...Light source drive circuit, 172...Light modulator drive circuit, 173...Projection optical system drive circuit, 210...Second processor, 211...Application execution unit, 220...Second memory, 221...Control program, 222...Adjustment application, 1121...First UI (First User Interface), 2211...Second UI (Second User Interface), G...Projected image, NW...Network, OB5...Fifth display object (Display object), SC...Screen.

Claims

1. A method for controlling a display system, The projection device displays a first user interface related to adjusting the projected image, The control device that communicates with the projection device displays a second user interface, which is a user interface related to adjusting the projected image and includes a display object corresponding to the projected image. When the projection device receives a first operation on the first user interface, it transmits first adjustment information based on the first operation to the control device. The projection device adjusts the projected image based on the first adjustment information, The control device updates the display object based on the first adjustment information, When the control device receives a second operation on the second user interface, it transmits second adjustment information based on the second operation to the projection device. The projection device adjusts the projected image based on the second adjustment information, The projection device updates the first user interface based on the second adjustment information, A method for controlling a display system.

2. When the control device receives an instruction to start adjusting the projected image, the projection device displays the first user interface. When the control device receives the instruction to start the adjustment of the projected image, it displays the second user interface. A method for controlling the display system according to claim 1.

3. When the projection device receives the instruction to start adjusting the projected image, the control device displays the second user interface. When the projection device receives the instruction to start the adjustment of the projected image, it displays the first user interface. A method for controlling the display system according to claim 1.

4. When the projection device receives the first operation, it updates the first user interface based on the first operation. The control device, upon receiving the second operation, updates the display object based on the second operation, A method for controlling a display system according to any one of claims 1 to 3.

5. The adjustment of the projected image is lens shift adjustment. The first user interface indicates the positional relationship between the lens-shiftable region, which allows the projected image to be moved by adjusting the lens shift, and the projected image. The aforementioned display object indicates the positional relationship between the lens-shiftable region and the projected image. A method for controlling a display system according to any one of claims 1 to 4.

6. A display system, Projection device and Includes a control device that communicates with the projection device, The projection device displays a first user interface related to the adjustment of the projected image, The control device that communicates with the projection device displays a second user interface, which is a user interface related to adjusting the projected image and includes a display object corresponding to the projected image. When the projection device receives a first operation on the first user interface, it transmits first adjustment information based on the first operation to the control device. The projection device adjusts the projected image based on the first adjustment information, The control device updates the display object based on the first adjustment information, When the control device receives a second operation on the second user interface, it transmits second adjustment information based on the second operation to the projection device. The projection device adjusts the projected image based on the second adjustment information, The projection device includes updating the first user interface based on the second adjustment information. Display system.