Method for selecting user interface screen, information processing terminal, and program

Abstract

To improve user operability when an information processing terminal functions as a remote controller for electronic devices.SOLUTION: A method for selecting a user interface screen includes: sending, by an information processing terminal, a display request of a user interface screen for operating an electronic device to the electronic device; determining, by the information processing terminal, whether or not the information processing terminal has a touch sensor; displaying, by the information processing terminal, a first user interface screen if the information processing terminal has the touch sensor; and displaying, by the information processing terminal, a second user interface screen different from the first user interface screen if the information processing terminal does not have the touch sensor.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a user interface screen selection method, an information processing terminal, and a program. [Background technology]

[0002] Patent Document 1 discloses a technology that allows a terminal with a touch sensor, such as a smartphone, to function as a remote controller for an electronic device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-177499 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the above-mentioned conventional technology, when a terminal that is premised on touch operation is made to function as a remote controller for an electronic device, the operability for the user is improved; however, when a terminal such as a PC (Personal Computer) that is premised on the combined use of keyboard operation and touch operation is made to function as a remote controller for an electronic device, the operability for the user may be degraded. [Means for solving the problem]

[0005] A method for selecting a user interface screen according to one embodiment of the present invention includes: sending, by an information processing terminal, to an electronic device a request to display a user interface screen for operating the electronic device; determining, by the information processing terminal, whether the information processing terminal has a touch sensor; displaying, by the information processing terminal, a first user interface screen if the information processing terminal has the touch sensor; and displaying, by the information processing terminal, a second user interface screen different from the first user interface screen if the information processing terminal does not have the touch sensor.

[0006] An information processing terminal of one embodiment of the present invention includes a wireless communication unit that wirelessly communicates with an electronic device, a display unit that displays images, an operation unit that accepts operations by a user, and a control unit that sends a display request for a user interface screen for operating the electronic device to the electronic device via the wireless communication unit, determines whether the operation unit has a touch sensor, and, if the operation unit has the touch sensor, displays a first user interface screen on the display unit, and, if the operation unit does not have the touch sensor, displays a second user interface screen different from the first user interface screen on the display unit.

[0007] A program according to one embodiment of the present invention causes a computer to execute the following steps: send a request to display a user interface screen for operating an electronic device to the electronic device via a wireless communication unit of the information processing terminal; determine whether an operation unit of the information processing terminal has a touch sensor; if the operation unit has the touch sensor, display a first user interface screen on a display unit of the information processing terminal; and if the operation unit does not have the touch sensor, display a second user interface screen different from the first user interface screen on the display unit. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing the overall configuration of a display system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram illustrating a configuration of an information processing terminal according to the present embodiment. [Figure 3] 1 is a first flowchart showing each process executed by a control unit. [Figure 4] FIG. 10 is a diagram illustrating an example of a first user interface screen. [Figure 5] 10 is a second flowchart showing each process executed by the control unit. [Figure 6] FIG. 10 is a diagram illustrating an example of a second user interface screen. [Figure 7] 10 is a third flowchart showing each process executed by the control unit. [Figure 8] 10 is a fourth flowchart showing each process executed by the control unit. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. In the drawings below, the dimensions of the components may be shown on different scales to make them easier to see.

[0010] Fig. 1 is a diagram showing the overall configuration of a display system 1 of this embodiment. As shown in Fig. 1, the display system 1 includes an information processing terminal 10 and a projector 20. The information processing terminal 10 functions as a remote controller that controls the projector 20 by remote operation.

[0011] The information processing terminal 10 may be a terminal having a touch sensor that detects touch operations by a user, or may be a terminal without a touch sensor. Touch operations include tapping, swiping, and dragging. The touch sensor may be any of a resistive touch sensor, a capacitive touch sensor, an ultrasonic touch sensor, and an infrared touch sensor.

[0012] In the following description, a terminal with a touch sensor may be referred to as a "touch-enabled terminal," and a terminal without a touch sensor may be referred to as a "non-touch-enabled terminal." Examples of touch-enabled terminals include smartphones, tablet terminals, and PDAs (Personal Digital Assistants). Examples of non-touch-enabled terminals include notebook PCs (Personal Computers) and desktop PCs.

[0013] The projector 20 is, for example, a liquid crystal projector, and projects an image onto the screen 30. The projector 20 is an example of an electronic device. The projector 20 projects a color image onto the screen 30 based on image signals corresponding to the respective color components of, for example, red, green, and blue. By projecting this image, a screen is displayed on the screen 30. The screen 30 here is a reflective screen, and is a projection surface onto which the image is projected by the projector 20. The projector 20 may be a projector that employs a reflective liquid crystal panel, a digital micromirror device (DMD), or the like.

[0014] The projector 20 is equipped with an operation panel. By pressing keys on the operation panel, a setting menu can be displayed and the projector 20 can be operated and set. For example, direction keys and a confirmation key are used to move between items in the setting menu and select an item.

[0015] Although not shown in Fig. 1, the projector 20 is equipped with physical keys and a conventional remote controller that uses infrared communication. The keys on this conventional remote controller have the same functions as the keys on the operation panel of the projector 20. In other words, the command that is sent when a key on the conventional remote controller is pressed is the same as the command that is issued internally when a key with the same function on the operation panel of the projector 20 is pressed.

[0016] 2 is a block diagram schematically illustrating the configuration of information processing terminal 10. As shown in FIG. 2, information processing terminal 10 includes wireless communication unit 11, display unit 12, operation unit 13, storage unit 14, and control unit 15.

[0017] The wireless communication unit 11 includes, for example, a wireless communication circuit and an antenna, and performs wireless communication with the projector 20 in accordance with instructions from the control unit 15. For example, the wireless communication unit 11 performs wireless communication in accordance with the IEEE802.11 (Wi-Fi: registered trademark) standard, but may also perform wireless communication in accordance with other standards (for example, infrared communication, Bluetooth (registered trademark)).

[0018] Display unit 12 displays an image based on an image signal input from control unit 15. For example, display unit 12 is a liquid crystal panel or an organic EL (Electro Luminescence) panel. In the following description, the rectangular area on display unit 12 where an image is displayed may be referred to as a "display surface."

[0019] The operation unit 13 includes one or more devices that accept operations by a user. When the information processing terminal 10 is a touch-enabled terminal, the operation unit 13 has at least a touch sensor. For example, when the touch sensor is a resistive touch sensor or a capacitive touch sensor, the touch sensor included in the operation unit 13 is a transparent plate-like device overlaid on the display surface of the display unit 12. In this way, a touch panel is formed by overlaying the transparent plate-like touch sensor on the display surface of the display unit 12.

[0020] The touch sensor repeatedly detects a position on the display surface indicated by the user's finger and outputs a signal corresponding to the detected position to the control unit 15. The touch sensor may detect a position indicated by a device such as a stylus pen instead of the user's finger. If the information processing terminal 10 is a non-touch terminal, the operation unit 13 has at least a keyboard and a mouse, but does not have a touch sensor. The keyboard and mouse output signals corresponding to operations received from the user to the control unit 15.

[0021] The storage unit 14 includes a nonvolatile memory that stores programs and various setting data required for the control unit 15 to execute various processes, and a volatile memory that is used as a temporary storage destination for data when the control unit 15 executes various processes. For example, the nonvolatile memory is an EEPROM (Electrically Erasable Programmable Read-Only Memory) or a flash memory. For example, the volatile memory is a RAM (Random Access Memory).

[0022] The programs stored in the storage unit 14 include an OS (Operating System) 141, a browser 142 that runs on the OS 141, and an operation application 143 that runs on the OS 141. The operation application 143 is an application program that causes the information processing terminal 10 to function as a remote controller for the projector 20. As will be described later, the information processing terminal 10 acquires the operation application 143 from the projector 20.

[0023] The control unit 15 is an arithmetic processing device that controls each unit of the information processing terminal 10 in accordance with a program stored in the storage unit 14. As an example, the control unit 15 is configured with one or more processors such as a CPU (Central Processing Unit). Some or all of the functions of the processor may be configured with circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). The processor executes various processes in parallel or sequentially.

[0024] 3 is a flowchart showing each process executed by the control unit 15. The control unit 15 executes a program stored in the storage unit 14 to execute each process shown in FIG.

[0025] When the user causes the information processing terminal 10 to function as a remote controller for the projector 20, the user performs an operation to select a browser launch icon displayed on the display unit 12 of the information processing terminal 10. In the following description, the operation of selecting the browser launch icon may be referred to as a "browser launch operation."

[0026] 3, the control unit 15 detects that a browser startup operation has been received based on an output signal from the operation unit 13 (step S1). When the control unit 15 detects that the browser startup operation has been received, the control unit 15 starts the browser 142 and displays a home screen of the browser 142 on the display unit 12 (step S2). Note that starting the browser 142 means that the control unit 15 executes the program of the browser 142.

[0027] On the home screen of the browser 142, the user performs an operation to access a control page screen that allows the user to search for a projector 20 that is to be remotely operated by the information processing terminal 10. In the following description, the operation to access the control page screen may be referred to as a "control page access operation."

[0028] The control unit 15 detects that a control page access operation has been received (step S3) based on the output signal of the operation unit 13. When the control unit 15 detects that a control page access operation has been received, the control unit 15 displays a control page screen on the display unit 12 (step S4).

[0029] On the control page screen, the user performs an operation to input the IP address of the projector 20 that is to be remotely operated by the information processing terminal 10. In the following description, the operation of inputting the IP address may be referred to as the "IP address input operation."

[0030] The control unit 15 detects that an IP address input operation has been received based on the output signal of the operation unit 13 (step S5). When the control unit 15 detects that an IP address input operation has been received, the control unit 15 transmits a transmission request for the operation application 143 to the projector 20 linked to the input IP address via the wireless communication unit 11, thereby acquiring the operation application 143 from the projector 20 (step S6).

[0031] The control unit 15 stores the operation application 143 acquired from the projector 20 in the storage unit 14. In this way, when the control unit 15 detects that an IP address input operation has been received, it downloads the operation application 143 from the projector 20 linked to the input IP address. Sending a request to send the operation application 143 to the projector 20 linked to the IP address is an example of sending to the electronic device a request to display a user interface screen for operating the electronic device. In the following description, the user interface screen may be referred to as a "UI screen."

[0032] After acquiring the operation application 143 from the projector 20, the control unit 15 starts up the operation application 143 (step S7). Note that starting up the operation application 143 means that the control unit 15 executes the program of the operation application 143. By executing the program of the operation application 143, the control unit 15 executes the processes from step S8 to step S10, which will be described later.

[0033] The control unit 15 determines whether or not the information processing terminal 10 is a touch-enabled terminal in accordance with the program of the operation application 143 (step S8). In other words, in step S8, the control unit 15 determines whether or not the operation unit 13 of the information processing terminal 10 has a touch sensor.

[0034] If the information processing terminal 10 is a touch-enabled terminal, i.e., if the operation unit 13 has a touch sensor (step S8: YES), the control unit 15 displays on the display unit 12 a first UI screen 100 for remotely operating the projector 20 using the touch-enabled terminal (step S9).

[0035] On the other hand, if the information processing terminal 10 is not a touch-enabled terminal, that is, if the operation unit 13 does not have a touch sensor (step S8: NO), the control unit 15 displays a second UI screen 200, which is different from the first UI screen 100, on the display unit 12 (step S10). The second UI screen 200 is a UI screen for remotely operating the projector 20 by a non-touch-enabled terminal. Image data of the first UI screen 100 and the second UI screen 200 are acquired from the projector 20 together with the program of the operation application 143.

[0036] 4 is a diagram showing an example of a first UI screen 100. The first UI screen 100 includes a touch operation area 101 in which a touch operation is detected by a touch sensor. The touch operation area 101 includes a menu read button 102, a return button 103, a screen switching button 104, and a reset button 105. In addition, a plurality of points P are arranged in a grid pattern in the touch operation area 101 to make it easier for the user to grasp the distance and direction of a swipe operation.

[0037] 5 is a flowchart showing each process executed by the control unit 15 after the first UI screen 100 is displayed. The control unit 15 executes the program of the operation application 143 to execute each process shown in FIG.

[0038] 5, after displaying the first UI screen 100, the control unit 15 detects a tap operation on the first UI screen 100 based on the output signal of the touch sensor (step S21). Based on the detected tap operation, the control unit 15 transmits a first command for operating the projector 20 to the projector 20 via the wireless communication unit 11 (step S22).

[0039] For example, when the control unit 15 detects a tap operation at the position where the menu read button 102 is located on the first UI screen 100, the control unit 15 sends a command to the projector 20 as a first command, instructing the projector 20 to display an OSD (On-Screen Display) menu screen.

[0040] For example, when the control unit 15 detects a tap operation at the position where the return button 103 is located on the first UI screen 100, the control unit 15 sends a command to the projector 20 as a first command instructing the projector 20 to return the screen displayed on the screen 30 to the previous screen.

[0041] For example, when the control unit 15 detects a tap operation at the position where the reset button 105 is located on the first UI screen 100, the control unit 15 sends a command to the projector 20 as a first command instructing it to reset various setting values ​​set on the OSD menu screen to their initial values. The operation of the control unit 15 when a tap operation is detected at the position where the screen switching button 104 is located on the first UI screen 100 will be described later.

[0042] 5, after displaying the first UI screen 100, the control unit 15 detects a swipe operation on the first UI screen 100 based on the output signal of the touch sensor (step S31). Based on the detected swipe operation, the control unit 15 transmits a second command for operating the projector 20 to the projector 20 via the wireless communication unit 11 (step S32).

[0043] For example, the control unit 15 transmits, as a second command, a command to change the position of a cursor on the OSD menu screen in synchronization with the detected swipe operation to the projector 20. For a specific method of transmitting a command to the projector 20 when a tap operation or a swipe operation is performed, see Patent Document 1.

[0044] As described above, when the information processing terminal 10, which is a touch-enabled terminal, is made to function as a remote controller for the projector 20, the user can remotely operate the projector 20 by performing touch operations on the first UI screen 100 displayed on the display unit 12 of the information processing terminal 10.

[0045] 6 is a diagram showing an example of a second UI screen 200. The second UI screen 200 includes a menu read button 201, a return button 202, a screen switching button 203, a reset button 204, an up button 205, a down button 206, a left button 207, a right button 208, and an enter button 209.

[0046] The correspondence between the buttons on the second UI screen 200 and the keys on the keyboard is shown below. The menu read button 201 can be operated with the "M" key on the keyboard. The return button 202 can be operated with the "esc" key or "back space" key on the keyboard. The reset button 204 can be operated with the "D" key on the keyboard. The up button 205 can be operated with the "↑" key on the keyboard. The down button 206 can be operated with the "↓" key on the keyboard. The left button 207 can be operated with the "←" key on the keyboard. The right button 208 can be operated with the "→" key on the keyboard. The decision button 209 can be operated with the "enter" key on the keyboard.

[0047] 7 is a flowchart showing each process executed by the control unit 15 after the second UI screen 200 is displayed. The control unit 15 executes the program of the operation application 143 to execute each process shown in FIG.

[0048] 7, after displaying the second UI screen 200, the control unit 15 detects a keyboard operation or a mouse operation related to the second UI screen 200 based on an output signal of the keyboard or the mouse (step S41). Based on the detected keyboard operation or mouse operation, the control unit 15 transmits a third command for operating the projector 20 to the projector 20 via the wireless communication unit 11 (step S42).

[0049] For example, when the control unit 15 detects a mouse click operation with the cursor positioned at the position where the menu read button 201 is located on the second UI screen 200, the control unit 15 transmits a command to display the OSD menu screen as the third command to the projector 20. Alternatively, when the control unit 15 detects that the "M" key on the keyboard has been pressed, the control unit 15 transmits a command to display the OSD menu screen as the third command to the projector 20.

[0050] For example, when the control unit 15 detects a mouse click operation with the cursor positioned at the position where the return button 202 is located on the second UI screen 200, the control unit 15 transmits, as a third command to the projector 20, a command instructing the projector 20 to return the screen displayed on the screen 30 to the previous screen. Alternatively, when the control unit 15 detects that the "esc" key or the "back space" key on the keyboard has been pressed, the control unit 15 transmits, as a third command to the projector 20, a command instructing the projector 20 to return the screen displayed on the screen 30 to the previous screen.

[0051] For example, when the control unit 15 detects a mouse click operation with the cursor positioned on the position where the reset button 204 is located on the second UI screen 200, the control unit 15 transmits a command to the projector 20 as a third command, which instructs the projector 20 to reset the various setting values ​​set on the OSD menu screen to their initial values. Alternatively, when the control unit 15 detects that the "D" key on the keyboard has been pressed, the control unit 15 transmits a command to the projector 20 as a third command, which instructs the projector 20 to reset the various setting values ​​set on the OSD menu screen to their initial values.

[0052] For example, when the control unit 15 detects a mouse click operation with the cursor positioned at the position where the up button 205 is located on the second UI screen 200, the control unit 15 transmits a command instructing the projector 20 to move the cursor on the OSD menu screen upward as a third command. Alternatively, when the control unit 15 detects that the "↑" key on the keyboard has been pressed, the control unit 15 transmits a command instructing the projector 20 to move the cursor on the OSD menu screen upward as a third command.

[0053] For example, when the control unit 15 detects a mouse click operation with the cursor positioned at the position where the decision button 209 is located on the second UI screen 200, the control unit 15 transmits a command instructing to perform decision processing as the third command to the projector 20. Alternatively, when the control unit 15 detects that the "enter" key on the keyboard has been pressed, the control unit 15 transmits a command instructing to perform decision processing as the third command to the projector 20.

[0054] As described above, when the information processing terminal 10, which is a non-touch-enabled terminal, is made to function as a remote controller for the projector 20, the user can remotely operate the projector 20 by performing keyboard or mouse operations related to the second UI screen 200 displayed on the display unit 12 of the information processing terminal 10.

[0055] It should be noted that even if the information processing terminal 10 is a touch-enabled terminal, there are cases where at least one of a keyboard and a mouse can be connected to the information processing terminal 10. In this way, when at least one of a keyboard and a mouse can be connected to the information processing terminal 10, which is a touch-enabled terminal, the user performs an operation to select the screen switching button 104 included in the first UI screen 100. For example, the operation to select the screen switching button 104 is a tap operation.

[0056] 8 is a flowchart showing each process executed by the control unit 15 after the first UI screen 100 is displayed. The control unit 15 executes the program of the operation application 143 to execute each process shown in FIG.

[0057] 8, after displaying the first UI screen 100, the control unit 15 detects a tap operation for selecting the screen switching button 104 included in the first UI screen 100 based on an output signal of the touch sensor (step S51). After detecting the tap operation for selecting the screen switching button 104, the control unit 15 displays the second UI screen 200 on the display unit 12 in place of the first UI screen 100 (step S52).

[0058] As described above, when an operation of selecting the screen switching button 104 included in the first UI screen 100 is performed, the information processing terminal 10 switches the UI screen displayed on the display unit 12 from the first UI screen 100 to the second UI screen 200. As a result, if the information processing terminal 10 is a touch-enabled terminal to which at least one of a keyboard and a mouse can be connected, the user can remotely operate the projector 20 using the keyboard or the mouse.

[0059] Similarly, when an operation of selecting the screen switching button 203 included in the second UI screen 200 is performed, the information processing terminal 10 switches the UI screen displayed on the display unit 12 from the second UI screen 200 to the first UI screen 100. This allows the user to again remotely control the projector 20 by a touch operation. In other words, the user can select, as the method of operating the projector 20, either a touch operation or a keyboard operation (or a mouse operation) according to his or her preference.

[0060] (Effects of this embodiment) The UI screen selection method of the present embodiment is realized by the control unit 15 executing each of the processes described above. That is, the UI screen selection method of the present embodiment includes the information processing terminal 10 transmitting to the projector 20 a display request for a UI screen for operating the projector 20, the information processing terminal 10 determining whether or not the information processing terminal 10 has a touch sensor, the information processing terminal 10 displaying a first UI screen 100 if the information processing terminal 10 has a touch sensor, and the information processing terminal 10 displaying a second UI screen 200 different from the first UI screen 100 if the information processing terminal 10 does not have a touch sensor.

[0061] According to the present embodiment as described above, when the information processing terminal 10 has a touch sensor, the first UI screen 100 is provided to the user, and when the information processing terminal 10 does not have a touch sensor, the second UI screen 200 is provided to the user. In this way, an appropriate UI screen is provided to the user depending on whether or not the information processing terminal 10 has a touch sensor, and therefore, when the user remotely operates the projector 20 using the information processing terminal 10, the operability for the user can be improved.

[0062] The UI screen selection method of this embodiment further includes detecting a tap operation on the first UI screen 100 by the information processing terminal 10 based on an output signal of the touch sensor after the first UI screen 100 is displayed, and transmitting a first command to the projector 20 by the information processing terminal 10 based on the detected tap operation.

[0063] According to the present embodiment as described above, the user can operate the projector 20 by performing a tap operation on the first UI screen 100 displayed on the information processing terminal 10.

[0064] The UI screen selection method of this embodiment further includes detecting a swipe operation on the first UI screen 100 by the information processing terminal 10 based on an output signal of the touch sensor after the first UI screen 100 is displayed, and transmitting a second command to the projector 20 by the information processing terminal 10 based on the detected swipe operation.

[0065] According to the present embodiment as described above, the user can operate the projector 20 by performing a swipe operation on the first UI screen 100 displayed on the information processing terminal 10.

[0066] The method for selecting a UI screen of this embodiment further includes detecting a keyboard operation or a mouse operation related to the second UI screen 200 by the information processing terminal 10 after displaying the second UI screen 200, and transmitting a third command to the projector 20 by the information processing terminal 10 to operate the projector 20 based on the detected keyboard operation or mouse operation.

[0067] According to the present embodiment as described above, the user can operate the projector 20 by performing keyboard operations or mouse operations related to the second UI screen 200 displayed on the information processing terminal 10.

[0068] The UI screen selection method of the present embodiment further includes detecting, by the information processing terminal 10, an operation of selecting a screen switching button 104 included in the first UI screen 100 based on an output signal of a touch sensor after the first UI screen 100 is displayed, and displaying, by the information processing terminal 10, a second UI screen 200 in place of the first UI screen 100 after the operation of selecting the screen switching button 104 is detected.

[0069] According to the present embodiment as described above, the user can select, according to his / her preference, either touch operation or keyboard operation (or mouse operation) as the method of operating the projector 20. This improves user convenience when the user remotely operates the projector 20 using the information processing terminal 10.

[0070] The information processing terminal 10 of this embodiment includes a wireless communication unit 11 that wirelessly communicates with the projector 20, a display unit 12 that displays images, an operation unit 13 that accepts operations by a user, and a control unit 15. The control unit 15 transmits a display request for a UI screen for operating the projector 20 to the projector 20 via the wireless communication unit 11, determines whether the operation unit 13 includes a touch sensor, displays a first UI screen 100 on the display unit 12 if the operation unit 13 includes a touch sensor, and displays a second screen 200 that is different from the first UI screen 100 on the display unit 12 if the operation unit 13 does not include a touch sensor.

[0071] According to the information processing terminal 10 of this embodiment as described above, an appropriate UI screen is provided to the user depending on whether or not the information processing terminal 10 has a touch sensor, thereby improving the operability for the user when remotely operating the projector 20 using the information processing terminal 10.

[0072] The program of this embodiment causes a computer to execute the following operations: send a display request for a UI screen for operating the projector 20 to the projector 20 via the wireless communication unit 11 of the information processing terminal 10; determine whether the operation unit 13 of the information processing terminal 10 includes a touch sensor; display a first UI screen 100 on the display unit 12 of the information processing terminal 10 if the operation unit 13 includes a touch sensor; and display a second UI screen different from the first UI screen on the display unit 12 if the operation unit 13 does not include a touch sensor. This computer is one or more processors that constitute the control unit 15 of the information processing terminal 10.

[0073] According to the program of this embodiment as described above, an appropriate UI screen is provided to the user depending on whether or not the information processing terminal 10 has a touch sensor, thereby improving user operability when the user remotely operates the projector 20 using the information processing terminal 10.

[0074] The technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present disclosure.

[0075] For example, in the above embodiment, the projector 20 is exemplified as an electronic device operated by the information processing terminal 10, but the electronic device of the present disclosure is not limited to a projector. The information processing terminal of the present disclosure can be widely applied as a terminal for operating electronic devices other than a projector.

[0076] Summary of the Disclosure A summary of this disclosure is provided below.

[0077] (Supplementary Note 1) A method for selecting a user interface screen, comprising: transmitting, by an information processing terminal, to an electronic device a request to display a user interface screen for operating the electronic device; determining, by the information processing terminal, whether the information processing terminal has a touch sensor; displaying, by the information processing terminal, a first user interface screen if the information processing terminal has the touch sensor; and displaying, by the information processing terminal, a second user interface screen different from the first user interface screen if the information processing terminal does not have the touch sensor.

[0078] According to the method described in Supplementary Note 1, if the information processing terminal has a touch sensor, a first user interface screen is provided to the user, and if the information processing terminal does not have a touch sensor, a second user interface screen is provided to the user. In this way, an appropriate user interface screen is provided to the user depending on whether or not the information processing terminal has a touch sensor, thereby improving operability for the user when operating an electronic device using the information processing terminal.

[0079] (Appendix 2) The method for selecting a user interface screen described in Appendix 1, further comprising: after displaying the first user interface screen by the information processing terminal, detecting a tap operation on the first user interface screen based on an output signal of the touch sensor; and transmitting a first command to the electronic device based on the detected tap operation by the information processing terminal.

[0080] According to the method described in Supplementary Note 2, a user can operate an electronic device by performing a tap operation on a first user interface screen displayed on an information processing terminal.

[0081] (Appendix 3) The method for selecting a user interface screen described in Appendix 1 or 2, further comprising: after displaying the first user interface screen by the information processing terminal, detecting a swipe operation on the first user interface screen based on an output signal of the touch sensor; and transmitting a second command to the electronic device based on the detected swipe operation by the information processing terminal.

[0082] According to the method described in Supplementary Note 3, a user can operate an electronic device by performing a swipe operation on a first user interface screen displayed on an information processing terminal.

[0083] (Appendix 4) The method for selecting a user interface screen described in any one of Appendices 1 to 3, further comprising: after displaying the second user interface screen, detecting a keyboard operation or a mouse operation related to the second user interface screen by the information processing terminal; and transmitting a third command to the electronic device based on the detected keyboard operation or the mouse operation by the information processing terminal, for operating the electronic device.

[0084] According to the method described in Supplementary Note 4, the user can operate the electronic device by performing keyboard or mouse operations related to the second user interface screen displayed on the information processing terminal.

[0085] (Appendix 5) The method for selecting a user interface screen described in any one of Appendices 1 to 4, further including: after displaying the first user interface screen by the information processing terminal, detecting an operation of selecting a screen switching button included in the first user interface screen based on an output signal of the touch sensor; and after detecting an operation of selecting the screen switching button by the information processing terminal, displaying the second user interface screen in place of the first user interface screen.

[0086] According to the method described in Supplementary Note 5, a user can select either touch operation or keyboard operation (or mouse operation) as the method of operating an electronic device, according to his / her preference. This improves the user's convenience when the user operates an electronic device using an information processing terminal.

[0087] (Supplementary Note 6) An information processing terminal comprising: a wireless communication unit that wirelessly communicates with an electronic device; a display unit that displays images; an operation unit that accepts operations by a user; and a control unit that transmits a display request for a user interface screen for operating the electronic device to the electronic device via the wireless communication unit; determines whether the operation unit has a touch sensor; displays a first user interface screen on the display unit if the operation unit has the touch sensor; and displays a second user interface screen different from the first user interface screen on the display unit if the operation unit does not have the touch sensor.

[0088] According to the information processing terminal described in Appendix 6, an appropriate user interface screen is provided to the user depending on whether or not the information processing terminal has a touch sensor, thereby improving user operability when the user uses the information processing terminal to operate an electronic device.

[0089] (Appendix 7) A program that causes a computer to execute the following steps: send a display request for a user interface screen for operating an electronic device via a wireless communication unit of the information processing terminal; determine whether an operation unit of the information processing terminal has a touch sensor; if the operation unit has the touch sensor, display a first user interface screen on a display unit of the information processing terminal; and if the operation unit does not have the touch sensor, display a second user interface screen different from the first user interface screen on the display unit.

[0090] According to the program described in Appendix 7, an appropriate user interface screen is provided to the user depending on whether or not the information processing terminal has a touch sensor, thereby improving user operability when the user operates an electronic device using the information processing terminal. [Explanation of symbols]

[0091] 1...display system, 10...information processing terminal, 20...projector, 30...screen, 11...wireless communication unit, 12...display unit, 13...operation unit, 14...storage unit, 15...control unit, 100...first user interface screen, 200...second user interface screen

Claims

1. transmitting a display request for a user interface screen for operating an electronic device to the electronic device by an information processing terminal; determining, by the information processing terminal, whether or not the information processing terminal has a touch sensor; displaying, by the information processing terminal, a first user interface screen when the information processing terminal has the touch sensor; displaying, by the information processing terminal, a second user interface screen different from the first user interface screen when the information processing terminal does not have the touch sensor; How to select a user interface screen, including:

2. After displaying the first user interface screen by the information processing terminal, detecting a tap operation on the first user interface screen based on an output signal of the touch sensor; transmitting, by the information processing terminal, a first command for operating the electronic device based on the detected tap operation, to the electronic device; The method of claim 1 further comprising:

3. After displaying the first user interface screen by the information processing terminal, detecting a swipe operation on the first user interface screen based on an output signal of the touch sensor; transmitting, by the information processing terminal, a second command for operating the electronic device based on the detected swipe operation to the electronic device; The method of claim 1 further comprising:

4. After displaying the second user interface screen, detecting a keyboard operation or a mouse operation related to the second user interface screen by the information processing terminal; transmitting, by the information processing terminal, a third command for operating the electronic device based on the detected keyboard operation or the detected mouse operation, to the electronic device; The method of claim 1 further comprising:

5. after displaying the first user interface screen, detecting, by the information processing terminal, an operation of selecting a screen switching button included in the first user interface screen based on an output signal of the touch sensor; displaying the second user interface screen in place of the first user interface screen by the information processing terminal after detecting an operation of selecting the screen switching button; The method of claim 1 further comprising:

6. a wireless communication unit that wirelessly communicates with the electronic device; a display unit for displaying an image; an operation unit that accepts operations by a user; transmitting a display request for a user interface screen for operating the electronic device to the electronic device via the wireless communication unit; determining whether the operation unit has a touch sensor; When the operation unit has the touch sensor, displaying a first user interface screen on the display unit; If the operation unit does not have the touch sensor, displaying a second user interface screen different from the first user interface screen on the display unit; a control unit that performs the above; An information processing terminal comprising:

7. transmitting a display request for a user interface screen for operating an electronic device to the electronic device via a wireless communication unit of the information processing terminal; determining whether an operation unit of the information processing terminal has a touch sensor; When the operation unit has the touch sensor, displaying a first user interface screen on a display unit of the information processing terminal; If the operation unit does not have the touch sensor, displaying a second user interface screen different from the first user interface screen on the display unit; A program that causes a computer to execute the following.

Images