Information processing system and input control method

Abstract

To improve a user experience in using another device having an input function as an input device without limiting applications.SOLUTION: A first information processing device 10 includes: a communication unit 35 that when a cursor movement instruction to move a cursor being displayed on a display unit 43 is input from an input unit 31, transmits cursor movement information about cursor movement to a second information processing device 20; and a display control unit 33 that when receiving a character string from the second information processing device 20, causes the display unit 34 to display the received character string. The second information processing device 20 includes: a display control unit 42 that when receiving the cursor movement information, moves the cursor being displayed on the display unit 43; a character string acquisition unit 44 that obtains a character string in a predetermined range which is specified from a cursor position after the movement; and a transmission unit 35 that transmits the obtained character string to the first information processing device 10.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present disclosure relates to an information processing system and an input control method. [Background technology]

[0002] For example, Patent Document 1 discloses a technique for connecting a smartphone and a display device via wireless communication and using the smartphone as a remote controller for the display device. Recently, a technology has been proposed that uses smartphones as input devices for notebook PCs, desktop PCs, tablet terminals, etc. This technology uses the standard software keyboard (hereinafter referred to as "SWKB") installed on smartphones as a PC keyboard. This enables one-handed input such as swipe input and flick input. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6378487 Summary of the Invention [Problem to be solved by the invention]

[0004] When using the SWKB of a smartphone as an input device, for example, only the newly entered character string before being sent to the PC is displayed on the smartphone. Therefore, for example, when adding to or correcting a long sentence, the user must look at the PC screen to check the sentences before and after, and must repeatedly move their eyes widely. Furthermore, since the character string before being sent to the PC is not displayed on the PC screen, the user must proceed with the correction of the sentence while mentally synthesizing the sentences before and after displayed on the PC screen with the character string being entered on the smartphone.

[0005] Another input method proposed for using a smartphone as an input device is to transfer image data of characters from the smartphone to the PC. However, in this case, the screen size becomes larger, so the character size on the smartphone becomes smaller. Also, when the text is enlarged to make it larger, scrolling occurs frequently, making it difficult to use in either case.

[0006] As another input method, applications are also available that allow document data to be stored in the cloud and edited on either a PC or a smartphone. However, in this case, the input method is limited to a specific application and does not have versatility.

[0007] Furthermore, the above-mentioned issues are not limited to the case where a smartphone is used as an input device, but are issues that commonly arise when other devices having input functions are used as external input devices.

[0008] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing system and an input control method that can improve the user experience when using other devices having input functions as input devices, without limiting the application. [Means for solving the problem]

[0009] A first aspect of the present disclosure includes a first information processing device having a first display unit and a first input unit, and a second information processing device having a second display unit, character An information processing system capable of displaying a character string on the first display unit and the second display unit in response to an input, In the stringa transmission unit that transmits cursor movement information regarding cursor movement to the second information processing device when a cursor movement instruction to move a cursor is input from the first input unit, and a display control unit that displays a character string on the first display unit when a character string is received from the second information processing device, and the second information processing device displays the character string on the second display unit when the second information processing device receives the cursor movement information. In the string displayed in A display control unit that moves a cursor; a character string acquisition unit that acquires a character string within a predetermined range that is specified from the position of the cursor after the cursor has been moved; For character input and a transmitting unit that transmits to the first information processing device.

[0010] A second aspect of the present disclosure is applied to an information processing system including a first information processing device having a first display unit and a first input unit, and a second information processing device having a second display unit, character An input control method for displaying character strings on the first display unit and the second display unit in response to an input, the first information processing device In the string When a cursor movement instruction for moving a cursor is input from the first input unit, the second information processing device executes a step of transmitting cursor movement information regarding cursor movement to the second information processing device, and when a character string is received from the second information processing device, the second information processing device executes a step of displaying the received character string on the first display unit, and when the second information processing device receives the cursor movement information, In the string A step of moving a cursor, a step of acquiring a character string within a predetermined range specified from the cursor position after the cursor has been moved, and For character input and transmitting the information to the first information processing device. Effect of the Invention

[0011] According to the present disclosure, it is possible to improve the user experience when using another device having an input function as an input device, without limiting the application to be used. [Brief description of the drawings]

[0012] [Figure 1] 1 is a system configuration diagram illustrating an overall configuration of an information processing system according to an embodiment of the present disclosure. [Diagram 2] 2 is a schematic configuration diagram illustrating an example of a hardware configuration of a first information processing device according to an embodiment of the present disclosure. [Diagram 3] FIG. 2 is a schematic configuration diagram illustrating an example of a hardware configuration of a second information processing device according to an embodiment of the present disclosure. [Figure 4] 1 is a functional configuration diagram illustrating an example of an input control function of an information processing system according to an embodiment of the present disclosure. [Diagram 5] FIG. 1 is a diagram for explaining an input control method according to an embodiment of the present disclosure. [Figure 6] FIG. 1 is a diagram for explaining an input control method according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a diagram for explaining an input control method according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] An information processing system and an input control method according to an embodiment of the present disclosure will be described below with reference to the drawings. Fig. 1 is a system configuration diagram illustrating an overall configuration of an information processing system 1 according to an embodiment of the present disclosure.

[0014] 1, the information processing system 1 includes a first information processing device 10 and a second information processing device 20. In the information processing system 1, the first information processing device 10 and the second information processing device 20 are configured to be able to transmit and receive information, and the first information processing device 10 is used, for example, as an input device for the second information processing device 20. Examples of the first information processing device 10 include a smartphone, a tablet terminal, etc. Examples of the second information processing device 20 include a notebook PC, a desktop PC, a tablet terminal, an all-in-one PC in which a PC main body and a display are integrated into a single housing, etc.

[0015] 2 is a schematic diagram showing an example of a hardware configuration of a first information processing device 10 according to an embodiment of the present disclosure. The first information processing device 10 includes, for example, a CPU (Central Processing Unit: processor) 11, a main memory 12, a secondary storage (secondary storage: memory) 13, an external interface 16, a communication interface 17, and a touch panel display 18. These components are connected to each other, for example, via a bus.

[0016] The CPU 11 controls the entire first information processing device by, for example, an OS (Operating System) stored in a secondary storage device 13 connected via a bus, and executes various processes by executing various programs stored in the secondary storage device 13. One or more CPUs 11 may be provided, and they may cooperate with each other to realize processes.

[0017] The main memory 12 is composed of writable memory such as a cache memory or a RAM (Random Access Memory), and is used as a working area for reading out execution programs of the CPU 11, writing processing data by the execution programs, and the like.

[0018] The secondary storage device 13 is a non-transitory computer readable storage medium. The secondary storage device 13 is, for example, a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Examples of the secondary storage device 13 include a ROM (Read Only Memory), a HDD (Hard Disk Drive), and a SSD (Solid State Drive) flash memory. The secondary storage device 13 stores, for example, an OS for controlling the entire first information processing device such as iOS (registered trademark), Android (registered trademark), Windows (registered trademark), a BIOS (Basic Input / Output System), various device drivers for operating peripheral devices as hardware, various application software, and various data and files. In addition, the secondary storage device 13 stores programs for implementing various processes and various data required for implementing various processes. A plurality of secondary storage devices 13 may be provided, and the above-mentioned programs and data may be divided and stored in each secondary storage device 13.

[0019] The external interface 16 is an interface for connecting to an external device. Examples of the external device include another information processing device (for example, the second information processing device 20), an external monitor, a USB memory, an external HDD, etc. Note that, although only one external interface is illustrated in the example shown in FIG. 2, multiple external interfaces may be provided.

[0020] The communication interface 17 is an interface for connecting to a network to communicate with other devices and for sending and receiving information. The touch panel display 18 functions as an input unit 31 (see FIG. 4) for giving input instructions to the first information processing device 10, and also functions as a display unit 34 (see FIG. 4) for providing information to the user.

[0021] A series of processes for realizing the functions of the first information processing device 10 is stored in the secondary storage device 13 or the like in the form of a program, for example, and the CPU (processor) 11 reads this program into the main memory 12 and executes information processing and arithmetic processing to realize various functions. Note that the program may be pre-installed in the secondary storage device 13, provided in a state stored in another non-transitory computer-readable storage medium, or distributed via wired or wireless communication means. Examples of non-transitory computer-readable storage media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0022] Fig. 3 is a schematic diagram showing an example of a hardware configuration of a second information processing device 20 according to an embodiment of the present disclosure. As shown in Fig. 3, the second information processing device 20 has, for example, substantially the same configuration as the first information processing device 10, and includes a CPU 21, a main memory 22, a secondary storage device 23, an external interface 26, a communication interface unit 27, and a touch panel display 28. Note that an input unit and a display unit may be provided instead of the touch panel display 28.

[0023] A series of processes for realizing the functions of the second information processing device 20 is stored in the secondary storage device 23 or the like in the form of a program, for example, and the CPU (processor) 21 reads this program into the main memory 22 and executes information processing and arithmetic processing to realize various functions. The program may be pre-installed in the secondary storage device 13, provided in a state stored in another non-transient computer-readable storage medium, or distributed via wired or wireless communication means. Examples of non-transient computer-readable storage media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0024] FIG. 4 is a functional configuration diagram showing an example of an input control function of the information processing system 1 according to the present embodiment. As shown in FIG. 4, the first information processing device 10 mainly comprises an input unit (first input unit) 31, an input control unit 32, a display control unit 33, a display unit (first display unit) 34, and a communication unit (transmission unit) 35.

[0025] The input unit 31 includes, for example, a keyboard for inputting character strings and up, down, left and right keys 31a (see FIGS. 5 to 7) for moving a cursor displayed on the display unit 43 of the second information processing device 20 up, down, left and right. In this embodiment, the input unit 31 is a software keyboard (SWKB).

[0026] The input control unit 32 creates (including deletes and modifies) a character string in response to an input from the input unit 31. Furthermore, when a cursor movement instruction to move a cursor displayed on the display unit 43 of the second information processing device 20 is input from the input unit 31, the input control unit 32 outputs cursor movement information regarding cursor movement to the communication unit.

[0027] The display control unit 33 displays the character string created by the input control unit 32 on the display unit 34. Furthermore, when the display control unit 33 receives a character string from the second information processing device 20, it causes the display unit 34 to display the received character string.

[0028] The communication unit 35 transmits and receives information to and from the second information processing device 20. For example, the communication unit 35 transmits character strings and cursor movement information output from the input control unit 32 to the second information processing device 20. In addition, the communication unit 35 outputs character strings received from the second information processing device 20 to the display control unit 33.

[0029] The second information processing device 20 includes, for example, a communication unit (transmission unit) 41, a display control unit 42, a display unit (second display unit) 43, and a character string acquisition unit 44. In addition, although not shown, the second information processing device 20 may include an input unit and an input control unit.

[0030] The communication unit 41 exchanges information with the first information processing device 10. For example, the communication unit 41 outputs a character string or cursor movement information received from the first information processing device 10 to the display control unit 42. In addition, the communication unit 41 transmits a character string output from the character string acquisition unit 44 to the first information processing device 10.

[0031] The display control unit 42 displays the character string received from the first information processing device 10 via the communication unit 41 on the display unit 43. When the display control unit 42 receives cursor movement information from the first information processing device 10 via the communication unit 41, the display control unit 42 moves the cursor displayed on the display unit 43 based on the cursor movement information.

[0032] The character string acquisition unit 44 acquires a character string in a predetermined range specified by the cursor position after the movement, and outputs the character string to the communication unit 41. For example, the character string acquisition unit 44 acquires a character string in paragraph units based on the cursor position. In other words, the character string acquisition unit 44 acquires a sentence from the beginning of the character string where the cursor is placed to the end of the sentence. This acquisition process can be realized by a combination of standard commands provided in the OS for information processing devices, such as moving the cursor to the beginning of the sentence, moving the cursor to the end of the sentence, and copying the selected range. When acquiring a character string via the system clipboard in this way, it is also possible to temporarily save the character string held in the clipboard immediately before and store it again after acquiring the character string, thereby preventing a negative effect on the user's use of the clipboard. In addition, the determination of whether the cursor is "moving" or "after moving" may be made by determining "after moving" a certain time t seconds after the cursor movement ends. By adjusting this time t in accordance with the communication speed between the information processing devices, the display delay time of the first information processing device can be shortened.

[0033] Next, an input control method by the information processing system 1 according to the present embodiment will be described with reference to the drawings. Hereinafter, a case where a smartphone is used as the first information processing device 10 and a notebook PC is used as the second information processing device 20 will be described as an example.

[0034] First, when a user operates the input unit 31 of the first information processing device 10, in other words, SWKB, a character string is generated based on this input operation by the input control unit 32. This character string is output to the display control unit 33 and is also transmitted to the display control unit 42 of the second information processing device 20 via the communication units 35 and 41.

[0035] The display control unit 33 displays the character string on the display unit 34, for example, in paragraph units. As a result, for example, as shown in Fig. 5, when "This is a pen." is input from SWKB, "This is a pen." is displayed on the display unit 34. Similarly, "This is a pen." is also displayed on the display unit 43 of the second information processing device 20. Specifically, in the second information processing device 20, the character string is displayed in the display area of ​​the application window W1 in the active state.

[0036] Subsequently, when the user makes further input, a character string based on the input from input unit 31 is created by input control unit 32 in the same manner as described above, and the created character string is output to display control unit 33 and also transmitted to display control unit 42 via communication units 35 and 41. As a result, the newly input paragraph (e.g., "That is a pen.") is displayed on display unit 34 as shown in FIG. 6. Also, "That is a pen." is displayed on display unit 43 following "This is a pen." which has been previously displayed. As the user continues the input operation, the latest character string is displayed in paragraphs on the display unit 34, and the input character string not exceeding a preset certain number of lines is displayed on the display unit 43. When the input character string exceeds the certain number of lines on the display unit 43, the oldest lines are no longer displayed, and the most recent certain number of lines of character string are displayed.

[0037] Next, for example, when the user wishes to check the text from the beginning and operates the up, down, left, right keys 31a provided on the input unit 31, cursor movement information based on the input of the up, down, left, right keys 31a is generated by the input control unit 32 and transmitted to the second information processing device 20 via the communication unit 35. In the second information processing device 20, the display control unit 42 moves the cursor displayed on the display unit 43 based on the cursor movement information. Here, it is assumed that the cursor C is moved to the center of the first line of character strings as shown in Fig. 7.

[0038] When the cursor is moved, the character string acquisition unit 44 acquires a character string within a predetermined range specified by the cursor position after the cursor is moved, and outputs this character string to the communication unit 41. For example, the character string acquisition unit 44 acquires a character string in paragraph units based on the cursor position. As a result, the sentence "This is a pen." is acquired, and the acquired character string is transmitted to the first information processing device 10 via the communication unit 41.

[0039] In the first information processing device 10, the character string "This is a pen." is output to the display control unit 33 and displayed on the display unit 34. As a result, the character string "This is a pen." is displayed on the display unit 34, as shown in FIG.

[0040] When the character string is modified, such as by adding or deleting a character, through the input unit 31, the input control unit 32 modifies the character string based on this input. As a result, the modification of the character string through the input unit 31 is reflected in the character string displayed on the display units 34 and 43.

[0041] As described above, the information processing system 1 and the input control method according to the present embodiment provide the following advantageous effects. The information processing system 1 according to this embodiment is a system capable of displaying character strings on the display units 34 and 43 in response to an input from the input unit 31 of the first information processing device 10. When a cursor movement instruction to move the cursor C displayed on the display unit 43 is input from the input unit 31 in the first information processing device 10, cursor movement information regarding the cursor movement is transmitted to the second information processing device 20. When the second information processing device 20 receives the cursor movement information, it moves the cursor on the display unit 43 and obtains a character string within a predetermined range specified from the cursor position after the movement, and transmits the obtained character string to the first information processing device 10. As a result, the display unit 34 of the first information processing device 10 displays a character string within a predetermined range based on the cursor position, for example, a character string for one paragraph where the cursor C is placed.

[0042] According to such a configuration, when a user wants to correct a created sentence, the user can perform an input operation of moving a cursor from the input unit 31 provided in the first information processing device 10 to the desired sentence, thereby displaying the desired sentence on the display unit 34 of the first information processing device 10. This makes it possible to make corrections while looking at the sentence displayed on the display unit 34. As a result, unlike the conventional method, it is no longer necessary to make corrections while alternately checking the character string displayed on the display unit 34 and the character string displayed on the display unit 43, and it becomes possible to easily check and correct the sentence. Furthermore, according to this embodiment, there is no limitation to a specific application. In this way, according to this embodiment, it is possible to improve the user experience when using another device having an input function as an input device, without limiting the application.

[0043] Although the present disclosure has been described above using the embodiments, the technical scope of the present disclosure is not limited to the scope described in the above embodiments. Various modifications or improvements can be made to the above embodiments without departing from the gist of the disclosure, and the forms with such modifications or improvements are also included in the technical scope of the present disclosure.

[0044] For example, in the above-described embodiment, the display control unit 33 displays character strings on the display unit 34 in paragraph units, but this is not limited to the example. For example, the display control unit 33 may display character strings within a range not exceeding a certain number of lines set in advance on the display unit 34. In this case, when the character string on the display unit 34 exceeds the certain number of lines, the oldest lines are no longer displayed, and the most recent certain number of lines of character string are displayed.

[0045] In the above embodiment, the character string acquisition unit 44 acquires character strings in paragraph units based on the cursor position, but the range of character strings acquired by the character string acquisition unit 44 is not limited to this example. For example, the user may be able to set conditions for character strings acquired by the character string acquisition unit 44.

[0046] Furthermore, the character string acquisition unit 44 may acquire a specified character string when a specific character string is specified among the character strings displayed on the display unit 43. For example, the character string range may be specified by the input unit 31 included in the first information processing device 10, in other words, by key operation of the SWKB, or may be configured to be specified from an input unit (not shown) included in the second information processing device 20 or another externally connected input device. [Explanation of symbols]

[0047] 1: Information processing system 10: First information processing device 11: CPU 12: Main memory 13:Secondary storage device 16: External interface 17: Communication interface 18: Touch panel display 20: Second information processing device 21: CPU 22: Main memory 23:Secondary storage device 26: External interface 27: Communication interface section 28: Touch panel display 31: Input section (first input section) 32: Input control section 33: Display control section 34: Display section (1st display section) 35: Communication unit (transmission unit) 41: Communication unit (transmission unit) 42: Display control section 43: Display section (second display section) 44: String acquisition part

Claims

1. An information processing system comprising: a first information processing device having a first display unit and a first input unit; and a second information processing device having a second display unit, and capable of displaying character strings on the first display unit and the second display unit in response to character input from the first input unit of the first information processing device, The first information processing device, a transmission unit that transmits cursor movement information regarding cursor movement to the second information processing device when a cursor movement instruction to move a cursor within a character string displayed on the second display unit is input from the first input unit; a display control unit that, when receiving a character string from the second information processing device, causes the first display unit to display the received character string; having The second information processing device is a display control unit that moves a cursor within a character string displayed on the second display unit when the cursor movement information is received; a character string acquisition unit that acquires a character string within a predetermined range identified from the moved cursor position; a transmission unit that transmits the acquired character string to the first information processing device for character input; An information processing system having the above configuration.

2. The information processing system according to claim 1 , wherein the character string acquisition unit acquires character strings in paragraph units based on the cursor position.

3. 2. The information processing system according to claim 1, wherein a user can set conditions for the character string to be acquired by the character string acquisition unit.

4. The information processing system according to claim 1 , wherein, when a predetermined character string is specified in the character strings displayed on the second display unit, the character string acquisition unit acquires the specified character string.

5. The information processing system according to claim 1 , wherein the first input unit includes a software keyboard.

6. An input control method that is applied to an information processing system including a first information processing device having a first display unit and a first input unit, and a second information processing device having a second display unit, and displays character strings on the first display unit and the second display unit in response to character input from the first input unit of the first information processing device, The first information processing device, transmitting cursor movement information regarding cursor movement to the second information processing device when a cursor movement instruction for moving a cursor within a character string displayed on the second display unit is input from the first input unit; when a character string is received from the second information processing device, displaying the received character string on the first display unit; Run The second information processing device is moving a cursor within a character string displayed on the second display unit when the cursor movement information is received; acquiring a character string within a predetermined range identified from the moved cursor position; transmitting the acquired character string to the first information processing device for character input; An input control method that performs:

Images