Display device, system, and program

Abstract

To provide a display device, a system, and a program that enable character input with a simple operation.SOLUTION: A first keyboard system application SY1 executed by a processing device 110 of a projector is called out by a service application AP-P and provides a character input function. The first keyboard system application SY1 uses a short-range wireless communication device driver HD1 to obtain character information indicating characters input on a smart phone. The service application AP-P uses a projection device to perform display based on the character information.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a display device, a system, and a program.

Background Art

[0002] Conventionally, a technology has been developed in which a projector and a terminal device are connected via a network, and characters are displayed on the projector based on a character input operation in the terminal device. For example, the system described in Patent Document 1 below converts handwritten characters input to a terminal device provided with a touch panel into character codes and transmits them to the projector. Alternatively, the system displays a software keyboard on the terminal device and transmits the character code corresponding to the touched character to the projector. Thereby, a character string based on the character code is displayed in the projected image of the projector.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] With the increasing functionality of projectors, there may be a need not only for simple operations using conventional cursors and buttons but also for more rapid input of character strings. In Patent Document 1 described above, although character input is possible on a terminal device connected to the projector, the use of the input characters is limited to the display of a character string in the projected image. In Patent Document 1, when it is possible to execute a plurality of applications on the projector side, it is not assumed to use the terminal device as a common interface for character input to these plurality of applications.

Means for Solving the Problems

[0005] A display device according to one aspect of the present invention includes a first communication device that communicates with a first terminal device, an optical device, a first service application that provides a service, a keyboard system application that is called by the first service application and provides a character input function, a first communication device driver that controls the first communication device, and an operating system that manages the first service application, the keyboard system application, and the first communication device driver. The processing device that executes the above, the keyboard system application acquires first character information indicating characters input in the first terminal device using the first communication device driver, and the first service application performs a display based on the first character information using the optical device.

[0006] A system according to one aspect of the present invention is a system including a display device and a terminal device. The display device includes a display device side communication device that communicates with the terminal device, an optical device, a service application that provides a service, a keyboard system application that is called by the service application and provides a character input function, a display device side communication device driver that controls the display device side communication device, and an operating system that manages the service application, the keyboard system application, and the display device side communication device driver. A display device side processing device that executes the above, the terminal device includes a terminal device side communication device that communicates with the display device, a terminal device side communication device driver that controls the terminal device side communication device, and a character input application that receives character input by a user. A terminal device side processing device that executes the above, the character input application transmits character information corresponding to the characters to the display device using the terminal device side communication device driver, the keyboard system application acquires the character information using the display device side communication device driver, and the service application performs a display based on the character information using the optical device.

[0007] A program according to an aspect of the present invention causes a processing device to acquire character information indicating characters input in the terminal device by using a communication device driver that controls a communication device that communicates with the terminal device, and to provide the character information to a service application that provides a service.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Embodiments for Carrying Out the Invention

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Note that the dimensions or scales of each part in the drawings are appropriately different from the actual ones, and there are also some parts schematically shown for easy understanding. Also, the scope of the present invention is not limited to these embodiments unless otherwise specifically stated in the following description.

[0010] 1. First Embodiment [System Configuration] FIG. 1 is a diagram showing the configuration of the display system 1 according to the embodiment. The display system 1 is an example of the system. The display system 1 includes a projector 10 and a smartphone 20.

[0011] The projector 10 is an example of a display device. The projector 10 projects the image PC onto a display surface F such as a wall surface or a screen. Hereinafter, when it is necessary to identify the image PC projected by the projector 10, it is denoted as image PC1, PC2, etc. The projector 10 is connected to the Internet using a wireless LAN (Local Area Network) communication device 107 described later, and can project information on the Internet onto the display surface F without going through devices such as a computer or a smartphone 20.

[0012] In the present embodiment, the projector 10 has an operating system similar to that of the smartphone 20 described later installed therein. Therefore, the projector 10 can execute various applications that can be executed on the smartphone 20. For example, the image PC1 projected by the projector 10 in FIG. 1 is the home screen of the projector 10, and a list of service applications that can be executed on the projector 10 is displayed. In the present embodiment, icons IC1 to IC3 are displayed as information for identifying individual service applications.

[0013] Icons IC1 to IC3 are displayed on the image PC1. When the user selects any one of the icons IC1 to IC3 with the moving cursor CM displayed on the image PC1, the application corresponding to the selected icon is launched. For example, the icon IC1 corresponds to an application for a video sharing service. Also, the icon IC2 corresponds to an application for a paid movie distribution service. Also, the icon IC3 corresponds to an application for a Web (World Wide Web) browser. The movement of the moving cursor CM and the selection of the icons IC1 to IC3 may be performed using, for example, the operation buttons 103 provided on the housing of the projector 10 or a remote controller (not shown). Note that the user interface used for the selection of the icons IC1 to IC3 is not limited to the moving cursor CM, and may be in a form in which the selected icons IC1 to IC3 are highlighted, for example, according to the operation of the user.

[0014] The smartphone 20 is an example of a terminal device. The smartphone 20 is, for example, a smartphone 20 owned by a user staying in the space where the projector 10 is arranged. In FIG. 1, two smartphones 20, i.e., a first smartphone 20A and a second smartphone 20B, are illustrated. The first smartphone 20A is an example of a first terminal device, and the second smartphone 20B is an example of a second terminal device. The number of smartphones 20 connected to the projector 10 may be one, or may be three or more.

[0015] In the present embodiment, the smartphone 20 is used when performing character input in a service application executed by the projector 10. Although details will be described later, a keyboard service application AP3 for performing character input in the projector 10 is installed in the smartphone 20. When it is necessary to perform character input on a service application AP-P executed by the projector 10, the user activates the keyboard service application AP3 on the smartphone 20 and performs character input on the keyboard service application AP3.

[0016] [Configuration of Projector 10] FIG. 2 is a block diagram showing the hardware configuration of the projector 10. The projector 10 includes a projection device 101, an operation button 103, a short-range wireless communication device 105, a wireless LAN communication device 107, a storage device 108, and a processing device 110.

[0017] The projection device 101 projects an image PC onto the display surface F. The projection device 101 is an example of an optical device. The projection device 101 includes an image processing circuit, a frame memory, a liquid crystal light valve, a light valve driving circuit, a light source, a projection optical system, etc. When the image processing circuit receives image data from the processing device 110 or an image supply device such as an image server (not shown), it expands the image data in the frame memory and performs necessary image processing. This image processing is, for example, processing for converting the resolution of the image data to the resolution of the liquid crystal light valve, geometric correction processing for eliminating trapezoidal distortion, etc. The image data after image processing is converted into an image signal, and based on the image signal, the liquid crystal light valve etc. is driven, whereby the image data is projected as an image. Note that the projection device 101 may be, for example, a DLP (Digital Lighting Processing, registered trademark) method in addition to the liquid crystal method using the above-described liquid crystal light valve etc.

[0018] The operation buttons 103 are provided on the housing of the projector 10 and receive various operations. The operation buttons 103 include, for example, a main power button, direction buttons, a determination button, etc.

[0019] The short-range wireless communication device 105 is used for communication between the projector 10 and the smartphone 20. That is, the short-range wireless communication device 105 communicates with the first smartphone 20A. Also, the short-range wireless communication device 105 communicates with the second smartphone 20B. The short-range wireless communication device 105 is an example of a first communication device and a display device-side communication device. The short-range wireless communication device 105 communicates with the smartphone 20 by a short-range wireless communication method such as Bluetooth, for example. Bluetooth is a registered trademark. In the present embodiment, it is assumed that the short-range wireless communication device 105 can communicate with a plurality of devices simultaneously by pairing with each of the plurality of devices. For example, the short-range wireless communication device 105 can communicate with the first smartphone 20A and the second smartphone 20B simultaneously.

[0020] The wireless LAN communication device 107 is used for communication with a wireless LAN router (not shown). The wireless LAN communication device 107 communicates with the wireless LAN router using a communication method such as Wi-Fi (Wi-Fi is a registered trademark). The wireless LAN router is a wireless LAN device having a mediation function between a wireless LAN access point and the Internet. At least a part of the service application AP-P executed by the processing device 110 provides a service using information on the Internet. For example, the paid movie distribution service corresponding to the icon IC2 acquires video data of a movie specified by the user from a server connected to the Internet and plays the video data. Note that the projector 10 may be connected to the Internet via a wired LAN.

[0021] The storage device 108 is a recording medium readable by the processing device 110. The storage device 108 includes, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), an eMMC (embedded Multimedia Card), a DDR DRAM (Double Data Rate Dynamic Random Access Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The storage device 108 stores various types of information and the program PG1 processed by the processing device 110. The program PG1 includes programs of various applications shown in FIG. 4. The program PG1 does not refer to a specific program but refers to the entire program stored in the storage device 108.

[0022] The processing device 110 is constituted by, for example, one or more processors. For example, the processing device 110 is constituted by one or more CPUs (Central Processing Unit). The CPU may be incorporated in a SoC (System on a Chip). Part or all of the functions of the processing device 110 may be constituted by circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). The processing device 110 executes various processes in parallel or sequentially. The processing device 110 is an example of a display device side processing device.

[0023] [Configuration of the smartphone 20] FIG. 3 is a block diagram showing the hardware configuration of the smartphone 20. The smartphone 20 includes a touch panel 201, a short-range wireless communication device 202, a storage device 205, and a processing device 210. Note that, in addition to the configuration shown in FIG. 3, the smartphone 20 may include a wireless LAN communication device similar to the projector 10, and a mobile phone communication device for connecting to a mobile phone communication network provided by a mobile phone carrier.

[0024] The touch panel 201 is a device in which a display for displaying an image and an input device for receiving various inputs are integrated. The touch panel 201 includes a light source, a display panel, and a sensor for detecting contact on the surface of the display panel. The touch panel 201 displays various images as a display. Further, the touch panel 201 detects a touch position which is the position where an object touches the surface of the touch panel 201. Based on the content of the image displayed on the display and the touch position on the display, the content of the input is specified.

[0025] The short-range wireless communication device 202 is a communication device using the same communication method as the short-range wireless communication device 105, and is used for communication between the projector 10 and the smartphone 20. The short-range wireless communication device 202 is an example of a terminal device-side communication device that communicates with the projector 10.

[0026] The storage device 205 is a recording medium readable by the processing device 210. The storage device 205 includes, for example, at least one of RAM, ROM, eMMC, DDR DRAM, and EEPROM. The storage device 205 stores various information and the program PG2 processed by the processing device 210. The program PG2 includes programs of various applications shown in FIG. 5. The program PG2 does not refer to a specific program, but refers to the entire program stored in the storage device 205.

[0027] The processing device 210 is composed of, for example, one or more processors. For example, the processing device 110 is composed of one or more CPUs. The CPU may be built into the SoC. Part or all of the functions of the processing device 110 may be composed of circuits such as DSP, ASIC, PLD, and FPGA. The processing device 210 executes various processes in parallel or sequentially. The processing device 210 is an example of a terminal device-side processing device.

[0028] [Program Configuration of Projector 10] FIG. 4 is a block diagram showing a program executed by the processing device 110 of the projector 10. By performing processing in accordance with the program PG1, the processing device 110 executes the service application AP-P, the system application SY-P, the hardware driver HD-P, and the operating system OS-P.

[0029] The service application AP-P provides services. The service application AP-P is, for example, an application corresponding to each of the icons IC1 to IC3 displayed on the image PC1 shown in FIG. 1. That is, the service application AP-P includes a video sharing service application AP1, a paid movie distribution service application AP2, and the like. For convenience of space in the figure, in the drawing, the word "application" is partially described as "app". The video sharing service application AP1 is an example of the first service application, and the paid movie distribution service application AP2 is an example of the second service application.

[0030] The system application SY-P is called by the service application AP-P and provides various functions. The system application SY-P includes, for example, a first keyboard system application SY1 and a storage access SY2. The storage access SY2 is a system application that manages, for example, whether an album application, which is one of the service applications AP-P, can access the recorded data of the system.

[0031] The first keyboard system application SY1 provides a character input function for the service application AP-P. The first keyboard system application SY1 is an example of a keyboard system application. For example, when character input is performed in the video sharing service application AP1 or when character input is performed in the paid movie distribution service application AP2, character input becomes possible by calling the first keyboard system application SY1. For example, the first keyboard system application SY1 is called by the video sharing service application AP1 and provides a character input function. Also, the first keyboard system application SY1 is called by the paid movie distribution service application AP2 and provides a character input function.

[0032] Here, a general keyboard system application has a function of displaying a software keyboard on a display surface F, a display, etc., and accepting the designation of characters on the software keyboard, such as the second keyboard system application SY3 described later. In contrast, the first keyboard system application SY1 has a function of receiving characters input by another information processing device, such as a smartphone 20.

[0033] In the present embodiment, the first keyboard system application SY1 has a system access function SA1. The first keyboard system application SY1 can access a short-range wireless communication device driver HD1 described later by the system access function SA1. When character input is performed from the smartphone 20, the system access function SA1 accesses the short-range wireless communication device driver HD1 and acquires character information indicating the characters input on the smartphone 20. That is, the first keyboard system application SY1 acquires character information indicating the characters input on the first smartphone 20A using the short-range wireless communication device driver HD1. The character information indicating the characters input on the first smartphone 20A is the first character information. Also, the first keyboard system application SY1 acquires character information indicating the characters input on the second smartphone 20B using the short-range wireless communication device driver HD1. The character information indicating the characters input on the second smartphone 20B is the second character information. The character information is, for example, character code information obtained by converting characters input by the user into a character code.

[0034] The service application AP-P that called the first keyboard system application SY1 displays characters on the application screen based on the acquired character information. For example, the video sharing service application AP1 performs display based on at least one of the first character information or the second character information using the projection device 101.

[0035] The hardware driver HD-P controls the hardware HW-P included in the projector 10. The hardware driver HD-P is prepared corresponding to the hardware HW-P included in the projector 10. In FIG. 4, a near-field wireless communication device 105 and a wireless LAN communication device 107 are illustrated as an example of the hardware HW-P included in the projector 10. As the hardware driver HD-P corresponding to these, a near-field wireless communication device driver HD1 and a wireless LAN communication device driver HD2 are executed. The near-field wireless communication device driver HD1 is an example of a first communication device driver and a display device side communication device driver. The near-field wireless communication device driver HD1 controls the near-field wireless communication device 105. Also, the wireless LAN communication device driver HD2 controls the wireless LAN communication device 107.

[0036] The operating system OS-P manages the entire internal system of the projector 10. For example, the operating system OS-P manages a service application AP-P including a video sharing service application AP1, a system application SY-P including a first keyboard system application SY1, and a hardware driver HD-P including a near-field wireless communication device driver HD1. In the present embodiment, the operating system OS-P of the projector 10 is software of the same type as the operating system OS-S of the smartphone 20. Specifically, the operating system OS-P may be, for example, Android OS or iOS. Android OS and iOS are registered trademarks.

[0037] [Program Configuration of Smartphone 20] FIG. 5 is a block diagram showing a program executed by a processing device 210 of a smartphone 20. By performing processing in accordance with a program PG2, the processing device 210 executes a service application AP-S, a system application SY-S, a hardware driver HD-S, and an operating system OS-S. The basic functions of the service application AP-S are the same as those of the service application AP-P. Similarly, the basic functions of the system application SY-S are the same as those of the system application SY-P, the basic functions of the hardware driver HD-S are the same as those of the hardware driver HD-P, and the basic functions of the operating system OS-P are the same as those of the operating system OS-S.

[0038] The service application AP-S includes, for example, a keyboard service application AP3 and a video sharing service application AP4. The video sharing service application AP4 is an application for uploading a video taken by a user to a server of a service provider so that it can be viewed by others, or for a user to view a video uploaded by others to the server of the service provider.

[0039] The keyboard service application AP3 is an application for performing character input from the smartphone 20 with respect to the service application AP-P executed by the projector 10. The keyboard service application AP3 is an example of a character input application.

[0040] In this embodiment, the keyboard service application AP3 has a GUI (Graphical User Interface) function SA2 and a system access function SA3. The keyboard service application AP3 can access a short-range wireless communication device driver HD3, which will be described later, through the system access function SA3. Also, the keyboard service application AP3 uses the GUI function SA2 to display on the touch panel 201 a character input interface screen as shown in FIGS. 8 to 10, for example. On the character input interface screen, a second keyboard system application SY3, which will be described later, is called, enabling keyboard input. The user of the smartphone 20 inputs characters to the character input interface screen using the touch panel 201. That is, the keyboard service application AP3 accepts character input by the user. The user is generally the user of the smartphone 20. The keyboard service application AP3 converts the characters input by the user into character information. Also, the keyboard service application AP3 transmits the character information corresponding to the characters input by the user to the projector 10 using the short-range wireless communication device driver HD3.

[0041] Note that an encryption processing function may be provided in the keyboard service application AP3 so that the character information is encrypted by the encryption processing function and then transmitted to the projector 10. In this case, the first keyboard system application SY1 of the projector 10 acquires the character information encrypted by the smartphone 20. The first keyboard system application SY1 provides the decrypted character information, which is obtained by decrypting the encrypted character information, to the service application AP-P. For example, the first keyboard system application SY1 receives the first character information encrypted by the first smartphone 20A. The first keyboard system application SY1 provides the decrypted first character information, which is obtained by decrypting the encrypted first character information, to the video sharing service application AP1.

[0042] The system application SY-S includes, for example, a second keyboard system application SY3 and a storage access SY4. The storage access SY4 is a system application that manages whether an album application, which is one of the service applications AP-S, can access the recorded data of the system.

[0043] The second keyboard system application SY3 is called by the service application AP-S and provides a character input function. For example, whether inputting characters with the keyboard service application AP3 or with the video sharing service application AP4, the second keyboard system application SY3 is called to enable character input. Therefore, when the user of the smartphone 20 uses the keyboard service application AP3 to input characters to the projector 10, character input can be performed using a keyboard in the same form as other service applications such as the video sharing service application AP4.

[0044] The second keyboard system application SY3 has a GUI function SA4 and a system access function SA5. The second keyboard system application SY3 can access the touch panel driver HD4 described later through the system access function SA5. Also, the second keyboard system application SY3 causes the software keyboard to be displayed on the touch panel 201 through the GUI function SA4. The second keyboard system application SY3 identifies the type of character input by the user by comparing the touch position by the user with the key arrangement on the software keyboard and accepts the input character.

[0045] Note that the system application SY-S may include multiple keyboard system applications. Each keyboard system application has different features, such as key layout, input methods for special characters such as emojis, and the dictionaries used. The user of the smartphone 20 can set which keyboard system application to use when entering text in the service application AP-S. By doing so, the user can enter text more comfortably.

[0046] The hardware driver HD-S is prepared to correspond to the hardware HW-S provided in the smartphone 20. In FIG. 4, a near-field wireless communication device 202 and a touch panel 201 are illustrated as an example of the hardware HW-P provided in the projector 10. As the hardware drivers HD-S corresponding to these, a near-field wireless communication device driver HD3 and a touch panel driver HD4 are executed. The near-field wireless communication device driver HD3 is an example of a terminal device-side communication device driver. The near-field wireless communication device driver HD3 controls the near-field wireless communication device 202. Also, the touch panel driver HD4 controls the touch panel 201.

[0047] [Details of Text Input in Display System 1] Next, the details of text input in the display system 1 will be described. Hereinafter, the case of performing text input in a paid movie distribution service application AP2, which is an example of the service application AP-P, will be described as an example.

[0048] When the icon IC2 is selected on the image PC1 shown in FIG. 1, the paid movie delivery service application AP2 is launched. FIG. 6 is a schematic diagram of an image PC2 showing the home screen of the paid movie delivery service application AP2. In addition to the thumbnails TH of the viewable movies, a search window WS for searching for viewable movies by keyword is displayed on the image PC2. When the user moves the cursor CM to the search window WS and presses the determination button, the paid movie delivery service application AP2 calls the first keyboard system application SY1. The first keyboard system application SY1 waits until it receives character information from the short-range wireless communication device driver HD1. The paid movie delivery service application AP2 displays a character input cursor CI in the search window WS and indicates to the user that it is in a state of waiting for character input.

[0049] When in a state of waiting for character input, the user launches the keyboard service application AP3 of the smartphone 20. FIG. 7 is a schematic diagram of an image PC3 showing the home screen of the smartphone 20. The image PC3 is displayed on the touch panel 201 of the smartphone 20. Icons IC4 to IC6 are displayed on the image PC3. For example, the icon IC4 corresponds to a web browser. Also, the icon IC5 corresponds to the video sharing service application AP4. Also, the icon IC6 corresponds to the keyboard service application AP3. When the user touches any of the icons IC4 to IC6, the application corresponding to the icons IC4 to IC6 is launched.

[0050] When the icon IC6 is touched on the image PC3, the keyboard service application AP3 is launched. When the keyboard service application AP3 is launched, pairing between the smartphone 20 and the projector 10 is performed by short-range wireless communication. Also, when the keyboard service application AP3 is launched, the display of the touch panel 201 switches to the image PC4.

[0051] Figures 8 to 10 are schematic diagrams showing the user interface of the keyboard service application AP3. In the image PC4 shown in FIG. 8, an input window WE where the entered characters are displayed and a message MS explaining the operation method are displayed. The image PC4 is displayed by the GUI function SA2 of the keyboard service application AP3. When the user taps the input window WE, the keyboard service application AP3 calls the second keyboard system application SY3. Also, the display of the touch panel 201 switches to the image PC5 shown in FIG. 9.

[0052] In the image PC5 shown in FIG. 9, in addition to the input window WE similar to that in FIG. 8, a software keyboard SK1 is displayed. The software keyboard SK1 is displayed by the GUI function SA4 of the second keyboard system application SY3. The software keyboard SK1 in FIG. 9 has a key group K1 corresponding to characters whose vowel is "a" arranged thereon, and flick input is possible. Note that the software keyboard SK1 may be displayed on the screen immediately after the keyboard service application AP3 is launched. That is, a display like that of the image PC5 may be shown immediately after the keyboard service application AP3 is launched.

[0053] Also, when the character type switching key K2 is pressed, for example, as shown in FIG. 10, a software keyboard SK2 with a different inputtable character type is displayed. The software keyboard SK2 shown in FIG. 10 has a key group K3 corresponding to numbers arranged thereon. In addition, a software keyboard capable of inputting alphabets or a software keyboard capable of inputting emojis may be displayed.

[0054] The software keyboards SK1 and SK2 are also displayed when performing character input in other service applications AP-S such as the video sharing service application AP4, for example. Therefore, the user can perform character input to the projector 10 using the keyboard they are familiar with.

[0055] Each time the user enters a character, the second keyboard system application SY3 passes character information indicating the character entered into the keyboard service application AP3. The keyboard service application AP3 uses the GUI function SA2 to display a character image corresponding to the entered character in the input window WE. The examples in FIGS. 9 and 10 show that the characters "hidamari" are entered in the input window WE.

[0056] When the input of characters is completed, the user presses the completion key K4. When the completion key K4 is pressed, the keyboard service application AP3 accesses the short-range wireless communication device driver HD3 and transmits the character information corresponding to the character string entered in the input window WE to the projector 10 using short-range wireless communication. That is, the keyboard service application AP3 transmits the character information corresponding to the characters entered by the user to the projector 10 using the short-range wireless communication device driver HD3.

[0057] Note that the timing of transmitting the character information is not limited to when the completion key K4 is pressed. For example, each time the user enters one character, the character information corresponding to the character may be transmitted to the projector 10.

[0058] The first keyboard system application SY1 receives the character information transmitted by the keyboard service application AP3 via short-range wireless communication. That is, the first keyboard system application SY1 uses the short-range wireless communication device driver HD1 to acquire the character information indicating the characters entered on the smartphone 20. Also, the first keyboard system application SY1 passes the received character information to the paid movie distribution service application AP2.

[0059] The paid movie delivery service application AP2 displays, for example, an image of characters corresponding to the delivered character information within the search window SW as shown in the image PC6 of FIG. 12. In the example of FIG. 12, the characters "Hidamari" are displayed in the search window SW. That is, the paid movie delivery service application AP2 performs display based on the character information acquired by the first keyboard system application SY1 using the projection device 101.

[0060] Thereafter, the paid movie delivery service application AP2 searches the work database using the input character string "Hidamari" and displays a list of movie works related to the character string "Hidamari" on the display surface F. The user selects a desired movie work from the displayed list of movie works and watches the selected movie work.

[0061] [Operation of the processing device 110 of the projector 10] FIG. 13 is a flowchart showing the operation of the processing device 110 of the projector 10. The processing device 110 controls the projection device 101 by using the hardware driver HD-P of the projection device 101 (not shown) to project a home screen such as the image PC1 illustrated in FIG. 1 onto the display surface F (step S100). The processing device 110 waits until one of the service applications AP-P is selected when the icons IC1 to IC3 displayed on the home screen are selected (step S102: NO).

[0062] When one of the service applications AP-P is selected (step S102: YES), the processing device 110 starts the selected service application AP-P and controls the projection device 101 to display the screen of the service application AP-P (step S104). For example, when the icon IC2 shown in FIG. 1 is selected, the projection device 101 starts the paid movie delivery service application AP2 and displays a home screen such as the image PC2 of FIG. 6 on the display surface F. The screen of the service application AP-P is appropriately switched by the user's operation or the like.

[0063] Until a text input window is specified on the screen of the service application (step S106: NO), the processing device 110 returns the processing to step S104. The text input window of the service application AP-P is, for example, the search window WS in the image PC2 of FIG. 6. When a text input window is specified on the screen of the service application (step S106: YES), the processing device 110 starts the first keyboard system application SY1 (step S108) and waits until character information is received by short-range wireless communication (step S110: NO).

[0064] When the character information is received (step S110: YES), the processing device 110 displays an image of the character corresponding to the character information in the input window on the screen of the service application AP-P (step S112). For example, in the search window WS of the image PC6 in FIG. 12, the character string "hidamari" is displayed based on the character information received from the smartphone 20. The processing device 110 returns the processing to step S104 until the user terminates the service application AP-P (step S114: NO). When the user terminates the service application AP-P (step S114: YES), the processing device 110 ends the processing according to this flowchart.

[0065] [Operation of the processing device 210 of the smartphone 20] FIG. 14 is a flowchart showing the operation of the processing device 210 of the smartphone 20. The processing device 210 waits until an instruction to start the keyboard service application AP3 is given (step S200: NO). The instruction to start the keyboard service application AP3 is given, for example, by touching the icon IC6 on the home screen such as the image PC3 illustrated in FIG. 7.

[0066] When the start of the keyboard service application AP3 is instructed (step S200: YES), the processing device 210 starts the keyboard service application AP3, and displays the screen of the keyboard service application AP3 on the touch panel 201 by the GUI function SA2 of the keyboard service application AP3 (step S202). The image PC4 in FIG. 8 is an example of the screen of the keyboard service application AP3.

[0067] When the input window WE of the keyboard service application AP3 is not touched (step S204: NO), the processing device 210 transfers the process to step S218. When the input window WE of the keyboard service application AP3 is touched (step S204: YES), the processing device 210 starts the second keyboard system application SY3 (step S206).

[0068] The processing device 210 displays a software keyboard on the touch panel 201 by the GUI function of the second keyboard system application SY3 (step S208). For example, in the image PC5 of FIG. 9, a software keyboard SK1 capable of inputting hiragana is displayed. The processing device 210 waits until a character key in the software keyboard is touched (step S210: NO), and when a character key is touched (step S210: YES), the processing device 210 displays an image indicating the character corresponding to the character key in the input window WE of the keyboard service application AP3 (step S212). In the example of FIG. 9, an image indicating the characters "hidamari" is displayed in the input window.

[0069] The processing device 210 returns the process to step S210 until the user finishes entering characters (step S214: NO). The end of character input corresponds to, for example, the pressing of the completion key K4 shown in FIG. 9 or the like. When the user finishes entering characters (step S214: YES), the processing device 210 transmits the character information of the input characters to the projector 10 using short-range wireless communication (step S216). At this time, the processing device 210 accesses the short-range wireless communication device driver HD3 through the system access function SA3 of the keyboard service application AP3 and transmits the character information. For example, in the example of FIG. 9, the character information corresponding to the character string "hidamari" is transmitted to the projector 10.

[0070] The processing device 210 returns the process to step S204 until the user terminates the keyboard service application AP3 (step S218: NO). When the user terminates the keyboard service application AP3 (step S218: YES), the processing device 210 ends the process according to this flowchart.

[0071] [Character Input from Multiple Smartphones 20] As shown in FIG. 1, a plurality of smartphones 20 can be connected to the projector 10. For example, when a plurality of users view an image displayed on the display surface F, it is possible to connect the smartphones 20 owned by the respective users to the projector 10. In the present embodiment, when there is character input from a plurality of smartphones 20 to the projector 10, all the character inputs from the plurality of smartphones 20 are accepted.

[0072] That is, the short-range wireless communication device driver HD1 communicates with the first smartphone 20A and a second smartphone 20B different from the first smartphone 20A. The first keyboard system application SY1 acquires first character information indicating characters input on the first smartphone 20A by using the short-range wireless communication device driver HD1. Further, the first keyboard system application SY1 acquires second character information indicating characters input on the second smartphone 20B by using the short-range wireless communication device driver HD1. The paid movie distribution service application AP2 performs a display based on the first character information and the second character information by using the projector 101.

[0073] For example, as shown in FIG. 12, if a character string "Hidamari" is input from the first smartphone 20A and then a character string "2010" is input from the second smartphone 20B before the search button BS is pressed, "Hidamari 2010" is displayed in the search window WS. By enabling character input from a plurality of smartphones 20 for one input window, the convenience when a plurality of users use the projector 10 simultaneously can be improved.

[0074] In addition, the first keyboard system application SY1 may be configured to accept character input only from the smartphone 20 that first performs character input among, for example, the first smartphone 20A or the second smartphone 20B. Further, the first keyboard system application SY1 may be configured to accept character input only from a pre-specified smartphone 20 among, for example, the first smartphone 20A or the second smartphone 20B.

[0075] [GUI Variation Example of Keyboard Service Application AP3] FIG. 11 is a schematic diagram showing another user interface of the keyboard service application AP3. In the image PC7 shown in FIG. 11, in addition to the input window WE, the software keyboard SK1, the character type switching key K2, and the completion key K4 similar to those in FIG. 9 and the like, a direction input key K5 and an OK key K6 are displayed.

[0076] The direction input key K5 is used, for example, when it is desired to move the movement cursor CM on the image PC1 shown in FIG. 1. The direction input keys K5 are arranged around the OK key K6 over 360 degrees. The user touches a position corresponding to the direction in which the object to be moved is to be moved in the area of the direction input key K5, with the OK key K6 being the current position of the object to be moved. For example, when it is desired to move the movement cursor CM in FIG. 1 to the right, the right side of the OK key K6 in the area of the direction input key K5 is touched.

[0077] The OK key K6 is pressed when determining the position of the object to be moved. For example, when the user desires to start the paid movie delivery service application AP2, with the image PC1 in FIG. 1 being displayed, the user moves the movement cursor CM to a position overlapping the icon IC2 using the direction input key K5. When the OK key K6 is pressed with the movement cursor CM overlapping the icon IC2, the processing device 110 recognizes that the icon IC2 has been selected and starts the paid movie delivery service application AP2.

[0078] Note that the forms of the direction input key K5 and the OK key K6 are not limited to those shown in FIG. 11. For example, the direction input key K5 may be a cross-shaped key with keys arranged vertically and horizontally. Also, the OK key K6 may be arranged at a position separated from the direction input key K5.

[0079] In this way, by providing a key for inputting directions in the interface of the keyboard service application AP3, operations other than character input can also be performed using the keyboard service application AP3, and the operability of the projector 10 can be improved.

[0080] As described above, in the display system 1 according to the first embodiment, the first keyboard system application SY1 of the projector 10 uses the short-range wireless communication device driver HD1 to acquire character information indicating the characters input on the smartphone 20. Further, the service application AP-P of the projector 10 performs a display based on the character information using the projection device 101. Thereby, the user can input characters to the projector 10 using the character input interface of the smartphone 20, which is predicted to be used more frequently than the projector 10. Therefore, the efficiency in character input is improved. Further, since the smartphone 20 is equipped with the touch panel 201, character input can be performed efficiently as compared with, for example, inputting characters from a software keyboard using a remote controller.

[0081] Further, the first keyboard system application SY1 is called by a plurality of service applications AP-P, such as a paid movie distribution service application AP2 and a video sharing service application AP1, and provides a character input function. Thereby, the user can perform character input using the smartphone 20 in all the service applications AP-P installed in the projector 10. Therefore, the convenience in character input is improved.

[0082] Further, if the character information indicating the characters input on the smartphone 20 is encrypted and transmitted and received by short-range wireless communication, it is possible to prevent a third party from illegally using the character information.

[0083] Further, the first keyboard system application SY1 acquires character information from a plurality of smartphones 20 and sequentially delivers the acquired character information to the service application AP-P. Therefore, the convenience when a plurality of users operate the projector 10 is improved.

[0084] 2. Second Embodiment Hereinafter, a second embodiment of the present invention will be described. For elements whose operations and functions are the same as those in the first embodiment in the forms exemplified below, the reference numerals used in the description of the first embodiment will be reused, and the detailed description of each will be omitted as appropriate.

[0085] [System Configuration] FIG. 15 is a diagram showing the configuration of a display system 2 according to the second embodiment. The display system 2 includes a remote controller 30 in addition to the projector 10 and the smartphone 20.

[0086] The remote controller 30 is an operation interface for operating the projector 10 from a remote location. The remote controller 30 is provided with a plurality of operation buttons 320 on the housing. When the user presses any one of the operation buttons 320, a signal corresponding to the operation button 320 is transmitted from the remote controller 30 to the projector 10. The projector 10 receives the received signal as an input from the remote controller 30.

[0087] [Configuration of Remote Controller 30] FIG. 16 is a block diagram showing the hardware configuration of the remote controller 30. The remote controller 30 includes, in addition to the operation buttons 320 described above, an infrared light emitting device 301, a storage device 302, and a processing device 310.

[0088] The operation buttons 320 include, for example, a power button for turning on and off the power of the projector 10, a cross key for specifying a direction, a determination key for confirming a selection, and numeric keys for inputting numbers.

[0089] The infrared light emitting device 301 is, for example, an LED (Light Emitting Diode) light emitting element having a peak wavelength of around 950 nm. The infrared light emitting device 301 is turned on and off under the control of the processing device 310.

[0090] The storage device 302 is a recording medium readable by the processing device 310. The storage device 302 includes, for example, at least one of RAM, ROM, eMMC, DDR DRAM, and EEPROM. The storage device 302 stores various information and the program PG3 processed by the processing device 210.

[0091] The processing device 310 is constituted by, for example, one or more processors. For example, the processing device 310 is constituted by one or more CPUs. The CPU may be built in the SoC. Part or all of the functions of the processing device 310 may be constituted by circuits such as DSP, ASIC, PLD, and FPGA. The processing device 310 executes various processes in parallel or sequentially. A microcontroller in which the storage device 302 and the processing device 310 are integrated may be used.

[0092] [Configuration of Projector 10] FIG. 17 is a block diagram showing the hardware configuration of the projector 10 in the second embodiment. In the second embodiment, the projector 10 includes an infrared light receiving device 106 in addition to the configuration shown in the first embodiment.

[0093] The infrared light receiving device 106 receives the infrared light emitted by the infrared light emitting device 301 of the remote controller 30. The infrared light receiving device 106 is used for communication between the projector 10 and the remote controller 30. That is, the infrared light receiving device 106 communicates with the remote controller 30. The infrared light receiving device 106 is an example of the second communication device. In this embodiment, infrared light is used for communication between the projector 10 and the remote controller 30, but it is not limited thereto, and for example, high frequency (RF: Radio Frequency) may be used.

[0094] FIG. 18 is a block diagram showing a program executed by the processing device 110 of the projector 10 in the second embodiment. In addition to the program shown in FIG. 4, the processing device 110 executes an infrared light receiving device driver HD5 that controls the infrared light receiving device 106 as one of the hardware drivers HD-P. The infrared light receiving device driver HD5 is an example of a second communication device driver.

[0095] When the operation button 320 of the remote controller 30 is pressed, the processing device 310 turns the infrared light emitting device 301 on and off at intervals corresponding to the pressed operation button 320. The infrared light emitted from the infrared light emitting device 301 is received by the infrared light receiving device 106 of the projector 10. The processing device 110 of the projector 10 identifies the operation button 320 corresponding to the on / off timing of the infrared light and performs processing corresponding to the identified operation button 320.

[0096] [Operation of the First Keyboard System Application SY1] In the second embodiment, the first keyboard system application SY1 accepts character input using the remote controller 30 in addition to character input using the keyboard service application AP3. For example, assume that the image PC2 shown in FIG. 6 is displayed on the display surface F. When the remote controller 30 is operated with the character input cursor CI displayed in the search window WS of the image PC2, the first keyboard system application SY1 displays the image PC8 shown in FIG. 19 on the display surface F.

[0097] The image PC8 includes a search window WS and a software keyboard SK3. On the software keyboard SK3, keys indicating each character of the 50 hiragana characters, keys indicating dakuten and handakuten, etc. are displayed. In the software keyboard SK3 of FIG. 19, the color of the key for "a" is different from the colors of the other keys, which indicates that the key for "a" is in a selected state.

[0098] The user uses the cross keys of the remote controller 30 to move the selected key. When the desired character key is selected, the user presses the determination key. The remote controller 30 turns the infrared light emitting device 301 on and off at intervals corresponding to the characters selected by the user. The projector 10 receives infrared light by the infrared light receiving device 106. The first keyboard system application SY1 accesses the infrared light receiving device driver HD5 through the system access function SA1 and obtains the reception interval of the infrared light. Also, based on the reception interval of the infrared light, the first keyboard system application SY1 identifies the character specified by the user and delivers the character code indicating the identified character to the paid movie delivery service application AP2. The paid movie delivery service application AP2 displays an image of the character corresponding to the delivered character code in the search window SW.

[0099] In this way, when the remote controller 30 is operated with the character input cursor CI displayed in the search window, the first keyboard system application SY1 operates in the same manner as a general keyboard system application.

[0100] That is, in the second embodiment, the first keyboard system application SY1 uses the infrared light receiving device driver HD5 to detect that the remote controller 30 has been operated. When the remote controller 30 is operated, the first keyboard system application SY1 uses the projection device 101 to display the software keyboard SK3. The first keyboard system application SY1 receives character input by using the infrared light receiving device driver HD5 to receive the designation of a character on the software keyboard SK3 based on the operation on the operation button 320.

[0101] As described above, in the second embodiment, the first keyboard system application SY1 accepts character input using the keyboard service application AP3 in addition to character input using the remote controller 30. As a result, for example, a user who does not have a smartphone 20 can also operate the projector 10, improving convenience.

[0102] 3. Modification Example Each of the embodiments illustrated above can be variously modified. Specific modification modes applicable to the above-described embodiments are illustrated below. Two or more modes arbitrarily selected from the following illustrations can be appropriately combined within a range that does not conflict with each other.

[0103] [Modification Example 1] The input accepted by the keyboard service application AP3 of the smartphone 20 is not limited to character input. The keyboard service application AP3 may display, for example, images such as a piano keyboard, a mole tap, a mixer for an audio channel, etc. as interfaces, and accept touches on the images as inputs. In this case, the keyboard service application AP3 assigns, for example, character codes to individual piano keys, etc. Then, the keyboard service application AP3 transmits the character code assigned to the input content corresponding to the touch position to the projector 10.

[0104] [Modification Example 2] The input to the smartphone 20 is not limited to the input using the touch panel 201. For example, the projector 10 may be operable using various sensors mounted on the smartphone 20. Examples of sensors mounted on the smartphone 20 and parameters detected by the sensors are listed below in the form of "sensor / parameter". Gyro sensor / movement, acceleration sensor / attitude, geomagnetic sensor / orientation, barometric pressure sensor / height and vertical movement, proximity sensor / proximity, ambient light sensor / brightness, GNSS (Global Navigation Satellite System) / latitude, longitude, pressure detection display / contact.

[0105] [Modification Example 3] By accepting handwritten input in the keyboard service application AP3, not only character input but also continuous shapes such as lines and figures using the touch panel 201 of the smartphone 20 can be input. Also, by providing a microphone and a system application SY-S for voice input to the smartphone 20, character input using voice becomes possible.

[0106] [Modification Example 4] In the present embodiment, the display system 1 projects the image PC onto the display surface F by the projector 10. However, the present invention is not limited to this, and the display system 1 may be, for example, a system that displays an image on a direct-view display. In this case, the display serves as a display device. When the display serves as a display device, instead of the projection device 101 shown in FIG. 2, a light source, a display panel, and the like are provided. The light source and the display panel are an example of an optical device.

[0107] [Modification Example 5] Also, in the present embodiment, the terminal device is assumed to be the smartphone 20. However, the present invention is not limited to this, and for example, a tablet terminal, a personal computer, or the like may be used.

Explanation of Reference Numerals

[0108] 1, 2, … represent the system, 10 … projector, 20 … smartphone, 20A … first smartphone, 20B … second smartphone, 30 … remote controller, 101 … projection device, 103 … operation button, 105 … short-range wireless communication device, 106 … infrared light receiving device, 107 … wireless LAN communication device, 108 … memory device, 110 … processing device, 201 … touch panel, 202 … short-range wireless communication device, 205 … memory device, 210 … processing device, 301 … infrared light emitting device, 302 … memory device, 310 … processing device, 320 … operation button, AP-P, AP-S … service applications, AP2 … paid movie distribution service application, AP3 … keyboard service application, F … display surface, HD-P, HD-S … hardware drivers, HD1, HD3 … short-range wireless communication device drivers, HD4 … touch panel driver, HD5 … infrared light receiving device driver, HW-P, HW-S … hardware, SY-P, SY-S … system applications, SY1 … first keyboard system application, SY3 … second keyboard system application.

Claims

1. A first communication device that communicates with a first terminal device, an optical device, a first service application that provides a service, a keyboard system application that is called by the first service application and provides a character input function, a first communication device driver that controls the first communication device, and an operating system that manages the first service application, the keyboard system application, and the first communication device driver, and a processing device that executes them, The keyboard system application acquires first character information indicating characters input in the first terminal device using the first communication device driver, The first service application performs a display based on the first character information using the optical device, A display device.

2. The processing device further executes a second service application different from the first service application, The keyboard system application is called by the second service application and provides a character input function, The display device according to Claim 1.

3. The keyboard system application acquires the first character information encrypted by the first terminal device, provides the decrypted first character information, which is obtained by decrypting the encrypted first character information, to the first service application, The display device according to Claim 1 or 2.

4. The first communication device further communicates with a second terminal device different from the first terminal device, The keyboard system application acquires second character information indicating characters input in the second terminal device using the first communication device driver, The first service application performs a display based on the first character information and the second character information using the optical device, The display device according to any one of Claims 1 to 3.

5. Further comprising a second communication device that communicates with a remote controller having operation buttons, The processing device further executes a second communication device driver that controls the second communication device, The keyboard system application detects that the remote controller has been operated using the second communication device driver, When it is detected that the remote controller has been operated, a software keyboard is displayed using the optical device, and character input is received by using the second communication device driver to accept the designation of a character on the software keyboard based on an operation on the operation button. The display device according to any one of claims 1 to 4. **Claim 6** A system including a display device and a terminal device, wherein the display device includes a display device side communication device that communicates with the terminal device, an optical device, a service application that provides a service, a keyboard system application that is called by the service application and provides a character input function, a display device side communication device driver that controls the display device side communication device, and an operating system that manages the service application, the keyboard system application, and the display device side communication device driver, and includes a display device side processing device that executes them. The terminal device includes a terminal device side communication device that communicates with the display device, a terminal device side communication device driver that controls the terminal device side communication device, and a character input application that receives character input by a user, and includes a terminal device side processing device that executes them. The character input application transmits character information corresponding to the characters to the display device using the terminal device side communication device driver. The keyboard system application acquires the character information using the display device side communication device driver. The service application performs display based on the character information using the optical device. System. **Claim 7** Causing a processing device to acquire character information indicating characters input in the terminal device using a communication device driver that controls a communication device that communicates with the terminal device, and to provide the character information to a service application that provides a service. Program.

Images