Display method, display system, and program

Abstract

To reduce a situation where an image not intended by a user is output to a display unit.SOLUTION: A display method includes: a terminal device displaying a second layer that is an image for receiving a first operation to select a content, superimposed on a first layer that is a content image; when a first content is selected by the first operation, the terminal device displaying the first layer in which an image of the first content is expanded as the content image; and a display unit displaying the first layer without superimposition of the second layer.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to a display method, a display system, and a program. [Background technology]

[0002] For example, there are cases where information indicating an image to be displayed on a terminal device such as a PC (Personal Computer) or a tablet terminal is transmitted from the terminal device to a display device such as a projector, and the display device projects an image based on the information.

[0003] Patent Document 1 discloses that in an image transmission system, a PC separates layers constituting a display screen into layers to be sent to a projector and layers not to be sent. Of the images displayed on the PC, the PC captures only the layers to be projected by the projector and outputs them to a display device. For example, if there is a layer that is not to be projected, the PC captures only the lower layer out of the upper and lower layers. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2005 / 088602 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology described in Patent Document 1, images to be output to a display device and images not to be output are displayed on the screen of the same terminal, which makes it easy for the user to make erroneous operations and raises the risk of an image not intended by the user being output to the display device. [Means for solving the problem]

[0006] A display method according to one embodiment of the present disclosure includes a terminal device displaying a first layer, which is a content image, overlaid with a second layer, which is an image that accepts a first operation for selecting content; when a first content is selected by the first operation, the terminal device displays the first layer in which an image of the first content is expanded as the content image; and a display device displays the first layer without overlaying the second layer.

[0007] A display system according to one embodiment of the present disclosure includes a terminal device that displays a first layer, which is a content image, overlaid with a second layer, which is an image that accepts a first operation for selecting content, and when a first content is selected by the first operation, displays the first layer in which an image of the first content is expanded as the content image, and a display device that displays the first layer without overlaying the second layer.

[0008] A program according to one embodiment of the present disclosure causes a computer to perform the following steps: display a first layer, which is a content image, overlaying a second layer, which is an image that accepts a first operation for selecting content; when a first content is selected by the first operation, displaying the first layer with an image of the first content expanded as the content image; and outputting information indicating the first layer without overlaying the second layer. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an outline of a display system used in a display method according to a first embodiment. [Diagram 2] 1 is a block diagram of a display system according to a first embodiment. [Diagram 3] 5 is a flowchart showing the operation of the terminal device in the display method according to the first embodiment. [Figure 4] 5 is a flowchart showing the operation of the display device in the display method according to the first embodiment. [Diagram 5] FIG. 11 is a diagram illustrating an example of an image displayed on a terminal device. [Figure 6] FIG. 13 is a diagram showing an example of displaying a second layer superimposed on a first layer. [Figure 7] FIG. 11 is a diagram for explaining a first operation. [Figure 8] FIG. 11 is a diagram for explaining a second operation. [Figure 9] 13 is a diagram showing a display example in which at least a part of the second layer is hidden. FIG. [Figure 10] FIG. 2 is a diagram showing an example of how the first layer is displayed on the display device. [Figure 11] FIG. 11 is a block diagram of a display system according to a second embodiment. [Figure 12] 13 is a flowchart showing the operation of a terminal device in a display method according to the second embodiment. [Figure 13] 10 is a flowchart showing the operation of a processing device of a relay terminal in a display method according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the dimensions and scale of each part in the drawings may differ from the actual dimensions, and some parts are shown diagrammatically to facilitate understanding. In addition, the scope of the present disclosure is not limited to these forms unless otherwise specified in the following description to the effect that the present disclosure is limited.

[0011] 1. First embodiment 1-1. Overview of the system used for the content editing method Fig. 1 is a diagram showing an outline of a display system 100 used in a display method according to a first embodiment. As shown in Fig. 1, the display system 100 includes a projector 10, which is an example of a "display device", and a terminal device 20. Each part of the display system 100 will be briefly described below with reference to Fig. 1.

[0012] The projector 10 is a display device that projects an image G indicated by image information D2 output from the terminal device 20 onto a projection area RP. In the example shown in Fig. 1, the projection area RP is a flat object such as a screen. Note that the object and shape of the projection area RP are not limited to the example shown in Fig. 1 and are arbitrary.

[0013] The terminal device 20 is a computer that executes various processes for implementing a display method described below, and has a function of receiving an operation from a user after displaying information necessary for the display method, and a function of outputting image information D2 indicating an image to be displayed on the projector 10 based on the operation from the user. In the example shown in Fig. 1, the terminal device 20 is a tablet terminal.

[0014] The terminal device 20 is not limited to a tablet terminal, and may be, for example, a notebook computer, a desktop computer, a smartphone, etc. In addition, while Fig. 1 illustrates an example in which the terminal device 20 is wirelessly connected to the projector 10 so as to be able to communicate with each other, the present invention is not limited to this example, and the terminal device 20 may be wired and connected to the projector 10 so as to be able to communicate with each other.

[0015] As will be described later in detail, the terminal device 20 has a display device 24 and an input device 25, and causes the display device 24 to display an image GU, which is a GUI (Graphical User Interface) image for accepting an operation of selecting any one of a plurality of contents using the input device 25. Then, the terminal device 20 outputs image information D2 indicating an image G to be used for projection by the projector 10 to the projector 10 based on an instruction from a user via the input device 25. This allows the image G to be displayed while switching between a plurality of contents, for example, in an educational setting or in a business use. For example, in an educational setting, a digital textbook, a tool for teaching support, video teaching materials, an image from a document camera, a whiteboard, etc. are used as the contents. Note that in FIG. 1, for convenience of explanation, the image G is an image representing the alphabet "A."

[0016] In the conventional mode in which content displayed on the terminal device 20 is input directly to the projector 10 by mirroring or the like, there is a possibility that elements that the operator of the terminal device 20 does not want to be displayed by the projector 10. Examples of elements that the operator of the terminal device 20 does not want to be displayed include passwords for logging in to various services, personal information, and operations during content switching. Examples of operations during content switching include moving content in a browser, opening a file by following a directory, and switching applications. It is not preferable for such operations to be displayed by the projector 10, as this can break the concentration of those receiving a lecture or presentation.

[0017] In the conventional mode in which content displayed on the terminal device 20 is input directly to the projector 10 by mirroring or the like, when information that should not be shown is displayed on the terminal device 20 or during switching of content, a possible countermeasure is to temporarily disconnect the terminal device 20 from the projector 10 or to use the image mute function or freeze function of the projector 10. However, although this countermeasure makes the operation during the content switching invisible, it not only increases the amount of work required for operation, but also extends the period of non-display for a long period of time, which causes a loss of concentration for those attending the class or presentation, and does not fundamentally solve the problem of confidential information being seen due to erroneous operation.

[0018] In addition, in other conventional aspects in which the area to be mirrored on the screen is limited by using a display expansion or application screen sharing function, and an area that is not mirrored is secured in part of the terminal device 20, it is time-consuming to move windows or switch applications. In addition, the display expansion or application screen sharing function generally depends on the OS (Operating System) of the computer used in the terminal device 20, and cannot be used on mobile tablet terminals.

[0019] Furthermore, when multiple contents are to be split and displayed simultaneously on two or more screens in order to facilitate a class or presentation, conventionally, functions provided by the OS, such as a function to display two application windows side by side, or an application splitting function on a tablet device, have been used. However, the screen splitting function is OS-dependent, and may not be available on some OSs, particularly mobile OSs. In addition, it is difficult to smoothly switch between two screens and full screen, or select a third application, and the operations are complicated and require skill. Furthermore, after arranging the applications on two screens, it is necessary to select the content to be displayed within each application, and during that time, the concentration of the audience in the class or presentation is lost.

[0020] In order to solve these problems, the terminal device 20 displays an image GU on the display device 24, which allows the content to be displayed on the projector 10 to be selected from multiple contents or to be split and displayed on the projector 10, while reducing operational errors by the operator of the terminal device 20.

[0021] 1-2.Display system Fig. 2 is a block diagram of a display system 100 according to the first embodiment. As shown in Fig. 2, the projector 10 has a storage device 11, a processing device 12, a communication device 13, an image processing circuit 14, a projection device 15, and an operation device 16. These are connected to each other so as to be able to communicate with each other.

[0022] The storage device 11 is a storage device that stores programs executed by the processing device 12 and data processed by the processing device 12. The storage device 11 includes, for example, a hard disk drive or a semiconductor memory. Note that a part or all of the storage device 11 may be provided in an external storage device or server outside the projector 10.

[0023] The processing device 12 is a processing device having a function of controlling each part of the projector 10 and a function of processing various data. The processing device 12 is configured to include a processor such as a CPU (Central Processing Unit). The processing device 12 may be configured with a single processor or multiple processors. In addition, some or all of the functions of the processing device 12 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). In addition, the processing device 12 may be integrated with the image processing circuit 14.

[0024] The communication device 13 is a communication device capable of communicating with the terminal device 20. For example, the communication device 13 is a wired communication device such as a wired LAN (Local Area Network), a USB (Universal Serial Bus), or an HDMI (High Definition Multimedia Interface), or a wireless communication device such as an LPWA (Low Power Wide Area), a wireless LAN including Wi-Fi, or Bluetooth. "HDMI", "Wi-Fi", and "Bluetooth" are each registered trademarks. Note that the communication device 13 may be capable of communicating with devices other than the terminal device 20.

[0025] The image processing circuit 14 is a circuit that performs necessary processing on the image information D2 from the communication device 13 and inputs it to the projection device 15. The image processing circuit 14 has, for example, a frame memory (not shown), and develops the image information D2 in the frame memory, appropriately performs various processes such as resolution conversion processing, resizing processing, and distortion correction processing, and inputs the information to the projection device 15. Note that the image processing circuit 14 may perform processes such as OSD (On Screen Display) processing that generates image information for menu display or operation guide, etc., and synthesizes it with the image information D2, as necessary.

[0026] The projection device 15 is a device that displays an image by projecting image light onto a projection region RP. The projection device 15 includes a light source device, a light modulation device, and a projection optical device.

[0027] The light source device of the projection device 15 includes a light source such as a halogen lamp, a xenon lamp, an ultra-high pressure mercury lamp, an LED (Light Emitting Diode), or a laser light source, and emits red, green, and blue light, respectively. The light modulation device 42 of the projection device 15 includes three light modulation elements provided corresponding to red, green, and blue. Each light modulation element includes, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, or a DMD (digital mirror device), and generates image light of each color by modulating light of the corresponding color. The image light of each color generated by the light modulation device is synthesized by a color synthesis optical system to become full-color image light. The projection optical device of the projection device 15 is a projection optical system including a projection lens and the like that forms an image of the full-color image light from the light modulation device on the projection region RP and projects it.

[0028] The operation device 16 is a device that accepts operations from a user. For example, the operation device 16 includes an operation panel and a remote control light receiving unit, not shown. The operation panel is provided on the exterior housing of the projector 10, and outputs a signal based on an operation from the user. The remote control light receiving unit receives an infrared signal from a remote control, not shown, decodes the infrared signal, and outputs a signal based on the operation of the remote control. Note that the operation device 16 is provided as necessary, and may be omitted.

[0029] 2, the terminal device 20 includes a storage device 21, a processing device 22, a communication device 23, a display device 24, and an input device 25. These are connected to each other so as to be able to communicate with each other.

[0030] The storage device 21 is a storage device that stores programs such as an operating system and application programs executed by the processing device 22, and data processed by the processing device 22. The storage device 21 includes, for example, a hard disk drive or a semiconductor memory. Note that a part or all of the storage device 21 may be an external storage device of the terminal device 20, or may be provided in an external device such as a server connected to the terminal device 20 via a communication network such as the Internet.

[0031] The storage device 21 stores a program PR, content information D1, and image information D2.

[0032] The program PR is a program for executing a display method, which will be described in detail later. The content information D1 is information relating to a plurality of contents. The contents are elements that can be displayed as images, such as applications, Web (World Wide Web) pages, video files, still image files, document files, spreadsheet files, presentation files, and the like. The image information D2 is information indicating a first layer LY1, which will be described later, and indicates an image of a first content, which is one content selected from the plurality of contents indicated by the content information D1.

[0033] The processing device 22 is a processing device having a function of controlling each part of the terminal device 20 and a function of processing various data. The processing device 22 includes a processor such as a CPU. The processing device 22 may be configured with a single processor or multiple processors. In addition, some or all of the functions of the processing device 22 may be realized by hardware such as a DSP, an ASIC, a PLD, or an FPGA.

[0034] The communication device 23 is a communication device capable of communicating with the projector 10 and the like. For example, the communication device 23 is a wired communication device such as a wired LAN, USB, or HDMI, or a wireless communication device such as a wireless LAN including LPWA and Wi-Fi, or Bluetooth. "HDMI", "Wi-Fi", and "Bluetooth" are each registered trademarks. Note that the communication device 23 may be capable of communicating with devices other than the projector 10.

[0035] The display device 24 displays various images under the control of the processing device 22. The display device 24 is a display device including various display panels such as a liquid crystal display panel and an organic EL display panel.

[0036] The input device 25 is an input device that accepts operations from a user. For example, the input device 25 includes a touch pad, a touch panel, or a pointing device such as a mouse. Here, when the input device 25 includes a touch panel, it may also function as the display device 24.

[0037] In the above-described terminal device 20, the processing device 22 functions as a reception unit 22a, a display control unit 22b, and a communication control unit 22c by executing the program PR stored in the storage device 21. Thus, the processing device 22 includes the reception unit 22a, the display control unit 22b, and the communication control unit 22c.

[0038] The reception unit 22a receives various operations from the user based on the input results to the input device 25. Specifically, the reception unit 22a receives a first operation and a second operation from the user via the input device 25. The first operation is an operation of selecting a content as the first content from the multiple contents indicated by the above-mentioned content information D1. The second operation is an operation of determining an area in which to display the content image Gc on the first layer LY1 described later.

[0039] The display control unit 22b controls the operation of the display device 24 to display various information on the display device 24. Specifically, the display control unit 22b causes the display device 24 to display an image GU required for executing a display method described below.

[0040] Based on the reception result of the reception unit 22a, the communication control unit 22c causes the communication device 23 to output various information. Specifically, based on the reception result of the reception unit 22a, the communication control unit 22c generates image information D2 and causes the communication device 23 to output the image information D2.

[0041] 1-3.Display method FIG. 3 is a flowchart showing the operation of the terminal device 20 in the display method according to the first embodiment. As shown in FIG. 3, in the terminal device 20, first, in step S101, the display control unit 22b causes the display device 24 to display an image GU. The image GU is an image in which a second layer LY2 described later is superimposed on a first layer LY1 described later. In this manner, in step S101, the terminal device 20 displays the second layer LY2 superimposed on the first layer LY1. This display example will be described later with reference to FIG. 5 and FIG. 6, and the first layer LY1 is a content image Gc described later which is an image of a content selected from a plurality of contents indicated by the above-mentioned content information D1. The second layer LY2 is an image Gu described later which accepts a first operation for selecting a first content from a plurality of contents indicated by the above-mentioned content information D1.

[0042] Next, in step S102, the accepting unit 22a determines whether or not the first operation has been accepted. This determination is made based on whether or not a content has been selected by the first operation from among the multiple contents indicated by the content information D1 described above, using the image GU, as will be described later with reference to FIG.

[0043] When the first operation is received (step S102: YES), in step S103, the display control unit 22b, based on the reception result of the reception unit 22a, sets the content selected by the first operation as the first content, and develops an image of the first content as a content image Gc on the first layer LY1. In this way, when the first content is selected by the first operation (step S102: YES), the terminal device 20 displays the first layer LY1 in which the image of the first content is developed as a content image Gc in step S103. Note that when step S103 is first executed, the display area of ​​the content image Gc on the first layer LY1 is the initial setting area, for example, the entire area of ​​the first layer LY1.

[0044] After step S103, or if the first operation is not accepted (step S102: NO), in step S104, the accepting unit 22a judges whether or not the second operation is accepted. This judgment is performed using the image GU, as will be described later with reference to Fig. 7. The second operation is an operation for determining an area in the first layer LY1 in which the content image Gc is to be displayed.

[0045] If the second operation is accepted (step S104: YES), in step S105, the display control unit 22b decides, based on the result of acceptance by the acceptance unit 22a, the area decided by the second operation as the display area of ​​the content image Gc on the first layer LY1. This decision will be described later with reference to Figs. 7 and 8.

[0046] After step S105, or if the second operation is not accepted (step S104: NO), in step S106, the communication control unit 22c generates image information D2, which is information indicating the first layer LY1, based on the acceptance result of the acceptance unit 22a, and causes the communication device 23 to output the image information D2. In this manner, in step S106, the terminal device 20 outputs information indicating the first layer LY1 as image information D2 to the projector 10. Here, the display area of ​​the content image Gc in the first layer LY1 indicated by the image information D2 is an area resulting from the execution of step S105 if step S105 has been executed, whereas it is an initial setting area if step S105 has never been executed.

[0047] After step S106, in step S107, the reception unit 22a determines whether or not there is an instruction to hide at least a part of the second layer LY2. This determination is made using an image GU, which will be described later with reference to FIG.

[0048] If there is an instruction to hide at least a part of the second layer LY2 (step S107: YES), in step S108, the display control unit 22b causes the display device 24 to display an image GU in which at least a part of the second layer LY2 is hidden. In this way, in step S108, the terminal device 20 hides at least a part of the second layer LY2. Here, the image GU in which at least a part of the second layer LY2 is hidden can accept an operation on the first layer LY1. Therefore, when at least a part of the second layer LY2 is hidden, the terminal device 20 accepts an operation on the first layer LY1 as necessary. In this embodiment, by executing step S108, operations on the second layer LY2 are disabled, except for an operation for canceling the display in step S108, as described later.

[0049] After step S108, in step S109, the reception unit 22a determines whether or not there is an instruction to display the entire second layer LY2. This determination is made using an image GU, as will be described later with reference to FIG.

[0050] If there is an instruction to display the entire second layer LY2 (step S109: YES), in step S110, the display control unit 22b causes the display device 24 to display an image GU displaying the entire second layer LY2. Thus, in step S110, the terminal device 20 displays the entire second layer LY2. Here, by canceling the display in step S108, the operations on the second layer LY2 that were disabled by execution of step S108 are enabled again.

[0051] After step S110, if there is no instruction to hide at least a part of the second layer LY2 (step S107: NO) or if there is no instruction to display the entire second layer LY2 (step S109: NO), in step S111, the reception unit 22a determines whether or not there is an end instruction. This determination is made based on, for example, whether or not there is an instruction to end the program PR. If there is no end instruction (step S111: NO), the display control unit 22b proceeds to step S102. On the other hand, if there is an end instruction (step S111: YES), the display control unit 22b ends the process.

[0052] Fig. 4 is a flowchart showing the operation of the projector 10 in the display method according to the first embodiment. In the projector 10, as shown in Fig. 4, first, in step S201, the communication device 13 acquires the image information D2 output from the terminal device 20 in the above-mentioned step S106. As a result, the projector 10 acquires the image information D2 as information indicating the first layer LY1.

[0053] After step S201, in step S202, the projection device 15 displays the image G indicated by the image information D2 input via the image processing circuit 14. As a result, in step S202, the projector 10 displays the first layer LY1 without overlaying the second layer LY2.

[0054] FIG. 5 is a diagram for explaining an example of an image GU displayed on the terminal device 20. In the above-mentioned step S101, an image GU as shown in FIG. 5 is displayed on the display device 24 of the terminal device 20. As shown in FIG. 5, the image GU has a first layer LY1 and a second layer LY2. Here, the second layer LY2 is displayed superimposed on the first layer LY1. Note that in FIG. 5, the first layer LY1 and the second layer LY2 are shown separately for convenience of explanation, but the image GU is a single image obtained by appropriately combining the first layer LY1 and the second layer LY2.

[0055] The first layer LY1 is a content image Gc, which is an image of the content selected in the above-mentioned step S102 from the multiple contents indicated by the above-mentioned content information D1.

[0056] The second layer LY2 is an image Gu that accepts a first operation of selecting a content from the plurality of contents indicated by the content information D1. The second layer LY2 includes a first region R1 for accepting the first operation, a second region R2 for accepting a second operation, and a button BT for switching between displaying and hiding at least a portion of the second layer LY2.

[0057] In the image GU, an image of a content selected by an operation on the first region R1 of the second layer LY2 is displayed on the first layer LY1 as a content image Gc. Then, image information D2 indicating the first layer LY1 is output from the terminal device 20 to the projector 10.

[0058] As will be described in detail later, in the first region R1, contents to be displayed on the projector 10 can be prepared in advance before a lesson or presentation and arranged as thumbnail images Ga to be described later. In addition, in the second region R2, a screen region to be projected by the projector 10 can be specified, and which contents are to be projected on which region can be input by an intuitive operation. Examples of such intuitive operations include a sliding operation or a dragging operation on a touch panel from the contents to the screen region.

[0059] Furthermore, the image GU can be switched between a state in which the entire second layer LY2 is displayed and a state in which at least a portion of the second layer LY2 is hidden by operating the button BT. When the entire second layer LY2 is displayed, operations on the first layer LY1 are prohibited. On the other hand, when at least a portion of the second layer LY2 is hidden, operations on the first layer LY1 are permitted. Examples of operations on the first layer LY1 include zooming in or out on content, switching or scrolling through a website, operating a web service, drawing on a whiteboard, etc.

[0060] Fig. 6 is a diagram showing a display example of the second layer LY2 superimposed on the first layer LY1. Fig. 6 shows an image GU after execution of the above-mentioned step S103. In the image GU, the second layer LY2 is displayed superimposed on the first layer LY1 so that it is in front.

[0061] Here, the second layer LY2 includes the first region R1, the second region R2, and the button BT as described above, and is displayed transparently in the areas other than these. As a result, the area of ​​the first layer LY1 is displayed in the image GU. At least one of the first region R1, the second region R2, and the button BT may be displayed semi-transparently.

[0062] The first area R1 is an area for receiving a first operation to select a content as a first content from the multiple contents indicated by the content information D1. A plurality of thumbnail images Ga-1 to Ga-5 are displayed in the first area R1. Hereinafter, the thumbnail images Ga-1 to Ga-5 may be referred to as thumbnail images Ga without being distinguished from one another. In the example shown in FIG. 6, the number of thumbnail images Ga displayed in the first area R1 is five. Note that the number of thumbnail images Ga displayed in the first area R1 is not limited to the example shown in FIG. 6, and may be four or less or six or more.

[0063] The plurality of thumbnail images Ga correspond to the plurality of contents indicated by the above-mentioned content information D1, and each thumbnail image Ga displays an image that allows the contents of the corresponding content to be roughly visually recognized.

[0064] In Figure 6, for ease of explanation, thumbnail image Ga-1 displays the letter "A," thumbnail image Ga-2 displays the letter "B," thumbnail image Ga-3 displays the letter "C," thumbnail image Ga-4 displays the letter "D," and thumbnail image Ga-5 displays the letter "E."

[0065] In practice, thumbnail image Ga displays an image showing the contents of, for example, an application, a web page, a video file, a still image file, a document file, a spreadsheet file, or a presentation file. The image displayed in thumbnail image Ga may be different from the image displayed on the first layer LY1. For example, if the content is a web page, thumbnail image Ga may display characters showing a shortcut to the URL (Uniform Resource Locator) of the web page.

[0066] The multiple thumbnail images Ga accept alternative selection. When any one of the multiple thumbnail images Ga receives an operation such as a tap, the reception unit 22a determines that the first operation has been received (step S102: YES). Here, the content corresponding to the one thumbnail image Ga that has received the operation is selected as the first content. In this way, the above-mentioned step S102 receives the first operation in the first region R1.

[0067] 6, the thumbnail image Ga-1 is selected, so that the image of the content corresponding to the thumbnail image Ga-1 is displayed as the content image Gc on the first layer LY1.

[0068] The second area R2 is an area for receiving a second operation for determining an area in the first layer LY1 in which the content image Gc is to be displayed. In the second area R2, images Gb1, Gb2, and Gb3 are displayed.

[0069] Image Gb1 is a display for receiving an operation to determine the left half of the first layer LY1 as the display area for the content image Gc. Image Gb2 is a display for receiving an operation to determine the entire area of ​​the first layer LY1 as the display area for the content image Gc. Image Gb3 is a display for receiving an operation to determine the right half of the first layer LY1 as the display area for the content image Gc.

[0070] The images Gb1, Gb2, and Gb3 accept alternative selection. When any one of the images Gb1, Gb2, and Gb3 receives an operation such as a tap, the reception unit 22a determines that the second operation has been received (step S104: YES). Then, in the above-mentioned step S105, the display area corresponding to the one image that has received the operation is determined as the display area of ​​the content image Gc in the first layer LY1. The content image Gc of the first content selected in step S102 is displayed in the determined display area. In this way, in the example shown in FIG. 6, the display area corresponding to the images Gb1, Gb2, and Gb3 can be determined as the second operation. Note that the display area that can be determined by the second operation is not limited to the example shown in FIG. 6, and for example, the display area corresponding to one of the images Gb1 and Gb3 may be omitted, or a display area such as a four-part division other than the display area corresponding to the images Gb1, Gb2, and Gb3 may be included.

[0071] In addition, on the second layer LY2, the first operation and the second operation can be performed simultaneously for any one of the images Gb1, Gb2, and Gb3 by sliding or dragging any one of the thumbnail images Ga.

[0072] 6, the image Gb2 is selected. As a result, in step S105, the content image Gc is displayed over the entire area of ​​the first layer LY1.

[0073] The button BT is a display for receiving an operation to switch whether or not to hide at least a part of the second layer LY2. For example, when the button BT receives an operation such as a tap in a state in which the entire second layer LY2 is displayed, the receiving unit 22a determines that an instruction to hide at least a part of the second layer LY2 has been given (step S107: YES). Then, in the above-mentioned step S108, the display control unit 22b causes the display device 24 to display an image GU in which at least a part of the second layer LY2 is hidden. In this embodiment, a part of the area of ​​the second layer LY2 except for the button BT is hidden in step S108. That is, in step S108, an image GU in which only the button BT is superimposed on the first layer LY1 is displayed. This display example will be described with reference to FIG. 9 described later. Note that in step S108, the display control unit 22b may cause the display device 24 to display an image GU in which the entire second layer LY2 is hidden, that is, only the content image Gc which is the first layer LY1.

[0074] Furthermore, after execution of the above-mentioned step S108, when the button BT is operated, such as tapped, with at least a portion of the second layer LY2 hidden, the reception unit 22a determines that there is an instruction to display the entire second layer LY2 (step S109: YES). Then, in the above-mentioned step S110, the display control unit 22b displays an image GU displaying the entire second layer LY2. In this way, each time the button BT is operated, the state is switched between hiding at least a portion of the second layer LY2 and displaying the entire layer.

[0075] In a state in which the second layer LY2 is entirely displayed, i.e., in a state in which the non-display state in step S108 has been cancelled, the first layer LY1 is partially hidden by the second layer LY2. In this state, operations on the first layer LY1 are prohibited. On the other hand, in a state in which at least a portion of the second layer LY2 is hidden, all or most of the area of ​​the first layer LY1 is displayed without being hidden by the second layer LY2. In this state, operations on the first layer LY1 are permitted. Therefore, for example, the results of operations on the first layer LY1 can be displayed on the projector 10.

[0076] Fig. 7 is a diagram for explaining the first operation. In the example shown in Fig. 7, the thumbnail image Ga-2 is selected. As a result, an image of the content corresponding to the thumbnail image Ga-2 is displayed as a content image Gc on the first layer LY1.

[0077] Fig. 8 is a diagram for explaining the second operation. In the example shown in Fig. 8, the image Gb1 is selected. As a result, the content image Gc is displayed over the left half area of ​​the first layer LY1. Note that Fig. 8 illustrates a case where the image Gb1 is selected in the state shown in Fig. 7 described above.

[0078] Fig. 9 is a diagram showing a display example in which at least a part of the second layer LY2 is hidden. When the above-mentioned step S108 is executed, as shown in Fig. 9, an image GU in which at least a part of the second layer LY2 is hidden is displayed. In this embodiment, the area of ​​the second layer LY2 except for the button BT is hidden. In this state, operations on the first layer LY1 are permitted. Therefore, for example, the operation state on the first layer LY1 can be displayed on the projector 10.

[0079] 10 is a diagram showing an example of display of the first layer LY1 by the projector 10. When the above-mentioned step S202 is executed, the projector 10 displays the image G indicated by the image information D2. The image G displays only the first layer LY1 without overlaying the second layer LY2.

[0080] As described above, the display method of this embodiment includes steps S101, S103, and S202. In step S101, as described above, the terminal device 20 displays the first layer LY1, which is the content image Gc, superimposed with the second layer LY2, which is the image Gu for accepting the first operation for selecting content. In step S103, if the first content is selected by the first operation (step S102: YES), the terminal device 20 displays the first layer LY1 in which the image of the first content is expanded as the content image Gc. In step S202, the projector 10 displays the first layer LY1 without superimposing the second layer LY2.

[0081] Here, the display method of the present embodiment is executed by a display system 100 including a terminal device 20 and a projector 10. That is, the display system 100 executes steps S101, S103, and S202.

[0082] The display method of this embodiment is realized by the terminal device 20, which is an example of a "computer," executing the program PR. The program PR causes the terminal device 20 to execute steps S101, S103, and S106. As described above, step S106 causes the terminal device 20 to output image information D2, which is information indicating the first layer LY1 without overlaying the second layer LY2.

[0083] In the above-described display method, display system 100, and program PR, the terminal device 20 displays the second layer LY2, which is an image that accepts a first operation for selecting content, superimposed on the first layer LY1, which is the content image Gc, so that it is possible to make it difficult to select images of elements other than the content that can be selected on the second layer LY2. This makes it difficult for the user to make an erroneous operation, thereby reducing the output of an image that is not intended by the user to the projector 10.

[0084] More specifically, the content that can be projected by the projector 10 is limited to the content displayed on the second layer LY2 by the program PR, which reduces the display of information displayed by other applications on the projector 10. Furthermore, by selecting the content to be displayed on the second layer LY2 by the first operation, the result of this switching is reflected on the first layer LY1, and the content displayed by the projector 10 is switched, so that the transition of this switching is not displayed by the projector 10. This solves the problem of people receiving a lecture or presentation losing concentration.

[0085] In this embodiment, as described above, the second layer LY2 includes a first region R1 in which thumbnail images Ga of multiple contents including the first content are displayed. In the display method of this embodiment, a first operation is received in the first region R1. This allows one content to be selected as the first content from the multiple contents. Here, since thumbnail images Ga of the multiple contents are displayed in the first region R1 of the second layer LY2, the user can know candidates for displayable content without having to have the projector 10 display the contents of the multiple contents. This solves the problem of a person receiving a lecture or presentation losing concentration.

[0086] As described above, the second layer LY2 further includes a second area R2 that accepts a second operation for determining an area in which the content image Gc is to be displayed on the first layer LY1, which allows the position, size, range, etc. in which the content image Gc is to be displayed to be changed as necessary.

[0087] Here, the display area of ​​the content image Gc on the first layer LY1 can be changed or the content allocation can be switched by intuitively operating the second region R2. Therefore, no skill is required for operations such as changing the display area of ​​the content image Gc on the first layer LY1. In addition, since the transition of this operation is not displayed by the projector 10, the problem of those receiving a lesson or presentation losing concentration is also solved.

[0088] Furthermore, as described above, the display method of this embodiment further includes step S108. Step S108 executes the steps of hiding at least a part of the second layer LY2, and accepting an operation on the first layer LY1 when at least a part of the second layer LY2 is hidden. In this way, by hiding at least a part of the second layer LY2, the content image Gc of the first layer LY1 is displayed in an easily viewable manner, and an operation on the first layer LY1 can be performed while improving operability. Then, the operation state can be displayed on the projector 10. Also, by hiding at least a part of the second layer LY2, it is possible to reduce the selection of content unintentionally by the user.

[0089] As described above, the display method of the present embodiment further includes step S106. In step S106, the terminal device 20 outputs image information D2, which is information indicating the first layer LY1, to the projector 10. This allows the projector 10 to display the first layer LY1 based on the image information D2.

[0090] 2. Second embodiment A second embodiment of the present disclosure will be described below. In the following exemplary embodiment, for elements whose actions and functions are similar to those of the first embodiment, the reference symbols used in the description of the first embodiment will be used and detailed descriptions of each will be omitted as appropriate.

[0091] Fig. 11 is a block diagram of a display system 100A according to the second embodiment. As shown in Fig. 11, the display system 100A includes a terminal device 20A instead of the terminal device 20 of the first embodiment, and is configured similarly to the display system 100 of the first embodiment, except that a relay terminal 30 is added. Here, the relay terminal 30 is connected to each of the terminal device 20A and the projector 10 wirelessly or by wire so as to be able to communicate with each other.

[0092] The terminal device 20A is configured similarly to the terminal device 20 of the first embodiment, except that a program PRA is stored in the storage device 21 instead of the program PR of the first embodiment, and that the terminal device 20A includes a communication control unit 22d instead of the communication control unit 22c. Here, the terminal device 20A has a function of controlling the operation of the relay terminal 30, and causes the content transferred from the relay terminal 30 to be displayed on the first layer LY1.

[0093] In the terminal device 20A, the processing device 22 functions as a reception unit 22a, a display control unit 22b, and a communication control unit 22d by executing the program PRA stored in the storage device 21. Thus, the processing device 22 includes the reception unit 22a, the display control unit 22b, and the communication control unit 22d.

[0094] The reception unit 22a and the display control unit 22b are the same as those in the first embodiment. However, the reception unit 22a and the display control unit 22b in this embodiment can use images displayed on the relay terminal 30 as content in addition to the multiple contents indicated by the content information D1.

[0095] Based on the reception result of the reception unit 22a, the communication control unit 22d controls the operation of the communication device 23. Specifically, based on the reception result of the reception unit 22a, the communication control unit 22d generates operation information D3, causes the communication device 23 to output the operation information D3, and causes the communication device 23 to input image information D2 from the relay terminal 30.

[0096] The operation information D3 is information for controlling the operation of the relay terminal 30, and indicates an operation on the image GU. The operation indicated by the operation information D3 includes an operation such as a mouse operation or a touch operation on the first layer LY1, and an operation such as a first operation and a second operation on the second layer LY2. That is, the operation information D3 includes information indicating an operation such as a mouse operation or a touch operation on the first layer LY1, and an operation such as a first operation and a second operation on the second layer LY2. The information indicating the operation on the first layer LY1 is, for example, information indicating the coordinate value on the first layer LY1 of the operation on the first layer LY1 when at least a part of the second layer LY2 is hidden. The operation information D3 is temporarily stored in the storage device 21, and is output from the communication device 23 as a signal indicating the first operation and the second operation.

[0097] The relay terminal 30 is a notebook or desktop computer, and has a function of displaying the image information D2 under the control of the terminal device 20A, and a function of outputting the image information D2 to the projector 10 and the terminal device 20A. Note that the relay terminal 30 is not limited to a notebook or desktop computer, and may be, for example, a stick-type computer, a tablet terminal, or a smartphone.

[0098] The relay terminal 30 includes a storage device 31, a processing device 32, a communication device 33, and a display device 34. These are connected to each other so that they can communicate with each other. In addition to the elements shown in Fig. 11, the relay terminal 30 may include an input device such as a touch pad, a touch panel, or a mouse that accepts operations from a user.

[0099] The storage device 31 is a storage device that stores programs such as an operating system and application programs executed by the processing device 32, and data processed by the processing device 32. The storage device 31 includes, for example, a hard disk drive or a semiconductor memory. Note that a part or all of the storage device 31 may be a storage device external to the relay terminal 30, or may be provided in an external device such as a server connected to the relay terminal 30 via a communication network such as the Internet.

[0100] The processing device 32 is a processing device having a function of controlling each part of the relay terminal 30 and a function of processing various data. The processing device 32 includes, for example, a processor such as a CPU. The processing device 32 may be configured with a single processor or multiple processors. Also, some or all of the functions of the processing device 32 may be realized by hardware such as a DSP, an ASIC, a PLD, or an FPGA.

[0101] The communication device 33 is a communication device capable of communicating with the projector 10, the terminal device 20, and the like. For example, the communication device 33 is a wired communication device such as a wired LAN, USB, or HDMI, or a wireless communication device such as a wireless LAN including LPWA and Wi-Fi, or Bluetooth. "HDMI", "Wi-Fi", and "Bluetooth" are each registered trademarks. Note that the communication device 33 may be capable of communicating with devices other than the projector 10 and the terminal device 20.

[0102] The display device 34 displays various images under the control of the processing device 32. The display device 34 is a display device including various display panels such as a liquid crystal display panel and an organic EL display panel.

[0103] 12 is a flowchart showing the operation of the terminal device 20A in the display method according to the second embodiment. The terminal device 20A operates in the same manner as the terminal device 20A in the first embodiment, except that steps S112, S113, and S114 are executed instead of steps S103, S105, and S106 in the first embodiment.

[0104] In the terminal device 20A, when the first operation is accepted (step S102: YES), in step S112, the communication control unit 22d outputs the operation information D3 to the communication device 23. As a result, in step S112, the terminal device 20A outputs a signal indicating the first operation to the relay terminal 30. Note that, when the first operation is not accepted (step S102: NO), step S104 is executed as in the first embodiment.

[0105] Furthermore, in the terminal device 20A, when the second operation is accepted (step S104: YES), in step S113, the communication control unit 22d outputs the operation information D3 to the communication device 23. As a result, in step S113, the terminal device 20A outputs a signal indicating the second operation to the relay terminal 30.

[0106] Furthermore, in the terminal device 20A, after step S113 or when the second operation is not accepted (step S104: NO), in step S114, the communication control unit 22d causes image information D2, which is information indicating the first layer LY1, to be input from the relay terminal 30 to the communication device 23. As a result, the terminal device 20A acquires the image information D2 in step S114. Here, the display control unit 22b updates the first layer LY1 displayed on the display device 24 based on the image information D2. Note that after step S114, step S107 is executed as in the first embodiment.

[0107] Fig. 13 is a flowchart showing the operation of the processing device 32 of the relay terminal 30 in the display method according to the second embodiment. As shown in Fig. 13, in the relay terminal 30, first, in step S301, the processing device 32 inputs operation information D3 from the terminal device 20A to the communication device 33. As a result, in step S301, a signal indicating a first operation or the like is input to the projector 10.

[0108] After step S301, in step S302, the processing device 32 uses the operation information D3 to display the content selected by the first operation as the first content and the image of the first content as the content image Gc on the first layer LY1 based on a signal indicating the first operation. At this time, the display area of ​​the content image Gc on the first layer LY1 is determined based on the second operation indicated by the operation information D3, and the content image Gc is displayed on the first layer LY1 in the determined display area. In this way, in step S302, the relay terminal 30 displays the first layer LY1 based on the first operation on the display device 34. Note that the relay terminal 30 only needs to display the content image Gc on the storage device 31 as an image, and does not need to display it on the display device 34. In addition, the relay terminal 30 may display the image of the first layer LY1 used in step S101 in response to the operation information D3 from the terminal device 20A. The image displayed on the first layer LY1 in the initial state may be blank or a predetermined image.

[0109] After step S302, in step S303, the processing device 32 generates image information D2, which is information indicating the first layer LY1, and causes the communication device 33 to output the image information D2 toward the projector 10 and the terminal device 20A. Thus, in step S303, the relay terminal 30 outputs information indicating the first layer LY1 as image information D2 to the projector 10 and the terminal device 20A. As a result, the projector 10 displays the first layer LY1 without overlaying the second layer LY2. Also, the terminal device 20A causes the content image Gc based on the image information D2 to be displayed on the first layer LY1.

[0110] The second embodiment described above also reduces the output of an image unintended by the user to the projector 10. As described above, the display method of this embodiment includes steps S112, S302, and S303. In step S112, when the first content is selected by the first operation, the terminal device 20 outputs a signal indicating the first operation to the processing device 32 of the relay terminal 30. In step S302, based on the signal, the processing device 32 develops an image of the first content on the first layer LY1. In step S303, the processing device 32 outputs image information D2, which is information indicating the first layer LY1, to the terminal device 20. In this way, in this embodiment, the content displayed under the control of the processing device 32 can be used as the first content. Therefore, any application available in the relay terminal 30 can be displayed on the projector 10.

[0111] As described above, the display method of the present embodiment also includes step S303. In step S303, the processing device 32 outputs image information D2, which is information indicating the first layer LY1, to the projector 10. This allows the projector 10 to display an image of the content displayed under the control of the processing device 32 as the first layer LY1.

[0112] 3. Variations Each of the above-mentioned exemplary embodiments may be modified in various ways. Specific modified embodiments that may be applied to each of the above-mentioned embodiments are illustrated below. Two or more embodiments selected from the following examples may be appropriately combined as long as they are not mutually contradictory.

[0113] 3-1. Variation 1 In the above-described second embodiment, an example is given in which the relay terminal 30 is separate from the projector 10, but the present invention is not limited to this example, and the relay terminal 30 may be integrated with the projector 10. In this case, among the above-described components of the relay terminal 30, elements other than the processing device 32 and the storage device 31 may be omitted as appropriate.

[0114] 3-2. Variation 2 In the above-described embodiment, a projector is used as the display device, but the present invention is not limited to this embodiment, and a video display device such as a flat panel display may be used as the display device instead of a projector.

[0115] 4. Notes The following is a summary of this disclosure.

[0116] (Supplementary Note 1) A display method of a first aspect, which is a preferred example of the present disclosure, includes a terminal device displaying a first layer, which is a content image, overlaid with a second layer, which is an image that accepts a first operation for selecting content; when a first content is selected by the first operation, the terminal device displays the first layer in which an image of the first content is expanded as the content image; and a display device displays the first layer without overlaying the second layer.

[0117] In the above aspect, the terminal device displays the second layer, which is an image that accepts a first operation for selecting content, over the first layer, which is a content image, so that it is possible to make it difficult to select images of elements other than the content selectable on the second layer. This makes it difficult for the user to make an erroneous operation, reducing the occurrence of an image that is not intended by the user being output to the display device.

[0118] (Supplementary Note 2) In a second aspect which is a preferred example of the first aspect, the second layer includes a first area in which thumbnail images of multiple contents including the first content are displayed, and the first operation is received in the first area. In the above aspect, one content can be selected as the first content from the multiple contents. Here, thumbnail images of the multiple contents are displayed in the first area of ​​the second layer, so that the user can know candidates for content that can be displayed without having to display the contents of the multiple contents on the display device. This solves the problem of people losing concentration during a lecture or presentation, etc.

[0119] (Note 3) In a third aspect, which is a preferred example of the first or second aspect, the second layer further includes a second area that accepts a second operation for determining an area in which the content image is to be displayed. In the above aspects, the position, size, range, etc. in which the content image is displayed can be changed as necessary.

[0120] (Supplementary Note 4) In a fourth aspect, which is a preferred example of any one of the first to third aspects, the fourth aspect further includes hiding at least a part of the second layer, and accepting an operation on the first layer when at least a part of the second layer is hidden. In the above aspect, by hiding at least a part of the second layer, the content image of the first layer is displayed in an easily viewable manner, and an operation on the first layer can be performed while improving operability. Then, the operation state can be displayed on the display device. Also, by hiding at least a part of the second layer, it is possible to reduce the selection of content unintentionally by the user.

[0121] (Supplementary Note 5) In a fifth aspect, which is a preferred example of any one of the first to fourth aspects, the terminal device outputs information indicating the first layer to the display device. In the above aspects, the first layer can be displayed on the display device based on the information indicating the first layer.

[0122] (Supplementary Note 6) In a sixth aspect which is a preferred example of any one of the first to fourth aspects, when the first content is selected by the first operation, the terminal device outputs a signal indicating the first operation to a processing device, the processing device develops an image of the first content on the first layer based on the signal, and the processing device outputs information indicating the first layer to the terminal device. In the above aspects, the content displayed under the control of the processing device can be used as the first content.

[0123] (Supplementary Note 7) In the seventh aspect, which is a preferred example of the sixth aspect, the processing device outputs information indicating the first layer to the display device. In the above aspect, an image of the content displayed under the control of the processing device can be displayed on the display device as the first layer.

[0124] (Appendix 8) A display system of an eighth aspect, which is a preferred example of the present disclosure, includes a terminal device and a display device, wherein the terminal device displays a first layer, which is a content image, overlaid with a second layer, which is an image that accepts a first operation for selecting content, and when a first content is selected by the first operation, displays the first layer in which an image of the first content is expanded as the content image, and the display device displays the first layer without overlaying the second layer.

[0125] In the above aspect, the terminal device displays the second layer, which is an image that accepts a first operation for selecting content, over the first layer, which is a content image, so that it is possible to make it difficult to select images of elements other than the content selectable on the second layer. This makes it difficult for the user to make an erroneous operation, reducing the occurrence of an image that is not intended by the user being output to the display device.

[0126] (Appendix 9) A program of a ninth aspect, which is a preferred example of the present disclosure, causes a computer to execute the following operations: display a first layer, which is a content image, overlaying a second layer, which is an image that accepts a first operation for selecting content; when a first content is selected by the first operation, displaying the first layer with an image of the first content expanded as the content image; and outputting information indicating the first layer without overlaying the second layer.

[0127] In the above aspect, the computer displays the second layer, which is an image that accepts a first operation for selecting content, over the first layer, which is a content image, making it difficult to select images of elements other than the content selectable on the second layer. This makes it difficult for the user to make an erroneous operation, reducing the occurrence of an image that is not intended by the user being output to the display device. [Explanation of symbols]

[0128] 10...projector (display device), 11...storage device, 12...processing device, 13...communication device, 14...image processing circuit, 15...projection device, 16...operation device, 20...terminal device, 20A...terminal device, 21...storage device, 22...processing device, 22a...reception unit, 22b...display control unit, 22c...communication control unit, 22d...communication control unit, 23...communication device, 24...display device, 25...input device, 30...relay terminal, 31...storage device, 32...processing device, 33...communication device, 34...display device, 42...light modulation device, 100...display system, 100A...display system, BT...button, D1...content information, D2...image information, D3...operation information, G...image, GU...image, Ga...thumbnail image, Ga-1...thumbnail image, Ga-2...thumbnail image, Ga-3...thumbnail image image, Ga-4...thumbnail image, Ga-5...thumbnail image, Gb1...image, Gb2...image, Gb3...image, Gc...content image, Gu...image, LY1...first layer, LY2...second layer, PR...program, PRA...program, R1...first area, R2...second area, RP...projection area, S101...step, S102...step, S103...step, S104...step, S105...step, S106...step, S107...step, S108...step, S109...step, S110...step, S111...step, S112...step, S113...step, S114...step, S201...step, S202...step, S301...step, S302...step, S303...step.

Claims

1. The terminal device displays a second layer, which is an image for receiving a first operation for selecting a content, superimposed on a first layer, which is a content image; When a first content is selected by the first operation, the terminal device displays the first layer in which an image of the first content is developed as the content image; and displaying the first layer without overlaying the second layer on the display device. Display method.

2. the second layer includes a first area in which thumbnail images of a plurality of contents including the first content are displayed; receiving the first operation in the first area; The display method according to claim 1 .

3. the second layer further includes a second area that accepts a second operation for determining an area in which the content image is to be displayed; The display method according to claim 1 .

4. hiding at least a portion of the second layer; and receiving an operation on the first layer when at least a portion of the second layer is not displayed. The display method according to any one of claims 1 to 3.

5. The terminal device further includes outputting information indicating the first layer to the display device. The display method according to any one of claims 1 to 3.

6. When the first content is selected by the first operation, the terminal device outputs a signal indicating the first operation to a processing device; Based on the signal, the processing device develops an image of the first content onto the first layer; The processing device further includes outputting information indicating the first layer to the terminal device. The display method according to any one of claims 1 to 3.

7. The processing device further includes outputting information indicating the first layer to the display device. The display method according to claim 6.

8. displaying a second layer, which is an image for receiving a first operation for selecting a content, superimposed on a first layer, which is a content image; When a first content is selected by the first operation, displaying the first layer in which an image of the first content is developed as the content image; A terminal device for performing the above-mentioned a display device that displays the first layer without overlaying the second layer, Display system.

9. displaying a second layer, which is an image for receiving a first operation for selecting a content, superimposed on a first layer, which is a content image; When a first content is selected by the first operation, displaying the first layer in which an image of the first content is developed as the content image; outputting information indicating the first layer without overlaying the second layer; program.

Images