Information processing device, control method for information processing device, and program

Abstract

To improve a convenience of a user when using a browser on a cloud.SOLUTION: An information processing apparatus capable of communicating with a communication terminal includes acquisition means that acquires Web information, processing means that performs processing of interpreting the Web information, and transmission means that transmits a processing result by the processing means to the communication terminal. The transmission means transmits, when instruction information that can be executed by the communication terminal is acquired by the processing means, the instruction information with priority over image data that is generated by the processing means and is displayed on the communication terminal.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device. , love The present invention relates to a control method and a program for an information processing device. [Background technology]

[0002] Currently, communication devices equipped with a web browser (hereafter referred to as a browser) and capable of viewing web pages on the browser are in widespread use. By displaying the web pages of external services through the browser, the communication device can link with the external services. Incidentally, there is a technology in which a browser running on a cloud server generates a rendering result of a web page, and transmits the rendering result to a communication terminal to display the web page on a terminal device that does not have a browser. Such a cloud-based browser runs on a virtual machine running on the cloud server. Various device resources required for a PC are virtually allocated to the virtual machine. Therefore, the browser running on the virtual machine can operate in the same way as when it runs on a PC. Patent Document 1 describes a cloud system that switches the type of browser depending on whether or not it handles privacy-related information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-200072 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, when using a browser designed to be able to call functions of a communication terminal on the cloud, there is a problem in that the communication terminal cannot execute a specified function until it receives the rendering result. For example, consider a browser designed to sound a sound from the communication terminal when a display item generated by an element with a disabled attribute is pressed. The sound is intended to inform the user that the corresponding element cannot be operated. Here, a web page has multiple <button> There is an element, of which one< / button> <button> Suppose an element has a disabled attribute. When using a general built-in browser, the user< / button> <button>When a button based on an element is pressed, a sound is played immediately. However, when using a cloud browser, the sound is played in conjunction with the notification of the rendering result as a result of the processing of the web page. Therefore, if it takes time to generate the rendering result, it may take a long time from when the user presses the button until the sound is played, which may confuse the user.

[0005] Therefore, an object of the present invention is to improve the convenience for users when using a browser on a cloud. [Means for solving the problem]

[0006] The information processing device of the present invention is an information processing device capable of communicating with a communication terminal, the information processing device including a first transmission means for transmitting a rendering result of a Web page to the communication terminal, and a Web page transmitted by the first transmission means. Rendering result of an acquisition means for acquiring information indicating an operation on the communication terminal for the Web page; a second transmission means for updating a drawing on the Web page in accordance with the operation indicated by the information acquired by the acquisition means and transmitting the updated drawing result to the communication terminal; is an operation on a specific item displayed on the Web page, command information resulting from the execution of the operation on the specific item A third transmitting means for transmitting to the communication terminal; and when the operation indicated by the information acquired by the acquisition means is an operation for the predetermined item displayed on the Web page, the third transmission means transmits the command information to the communication terminal in priority to the transmission of the updated drawing result by the second transmission means, and the second transmission means transmits the updated drawing result to the communication terminal after the transmission of the command information by the third transmission means. Characterized by 。 Effect of the Invention

[0007] According to the present invention, it is possible to improve the convenience for users when using a browser on a cloud. [Brief description of the drawings]

[0008] [Figure 1A] FIG. 2 illustrates an example of a hardware configuration of a virtual machine. [Figure 1B] FIG. 2 is a diagram illustrating an example of the hardware configuration of a communication terminal and a web server. [Diagram 2] FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system. [Diagram 3] 5 is a flowchart showing a process flow of the communication terminal of the first embodiment. [Figure 4] 11 is a flowchart showing a flow of processing of a virtual machine according to the first embodiment. [Diagram 5] 3A to 3C are diagrams illustrating an example of a description of a Web page and a rendering result according to the first embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of a command table according to the first embodiment. [Figure 7] 13 is a flowchart showing a flow of processing of a virtual machine according to the second embodiment. [Figure 8] 13A to 13C are diagrams illustrating an example of a description of a Web page and a rendering result according to the second embodiment. [Figure 9] FIG. 11 illustrates an example of an instruction table according to the second embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that the following embodiment does not limit the present invention related to the scope of the claims, and not all of the combinations of features described in the present embodiment are necessarily essential to the solution of the present invention. Note that the same components are described with the same reference numerals.

[0010] <First embodiment> In this embodiment, the virtual machine 100 runs a browser available to the communication terminal 110 on the cloud. When processing a Web page, if there is an execution command executable by the communication terminal 110, the virtual machine 100 provides the execution command to the communication terminal 110 with priority over the rendering result of the Web page. This makes it possible to execute the operation on the communication terminal 110 quickly even if it takes time to generate the rendering result. In this embodiment, an example will be described in which the communication terminal 110 sounds a sound in response to a user operation on a specific element included in a Web page written in HTML format. Specifically, the virtual machine 100 provides a Web page to which a disable attribute or a readonly attribute has been assigned.< / button> <button>Elements and <input> When a user presses a display item based on the element, a sound is emitted from the communication terminal. A web page is an example of web information. In this embodiment, the virtual machine 100 is configured to obtain an execution command when a predetermined operation is performed, but the present invention is not limited to this, and may be configured to obtain an execution command when an error notification or the like is received.

[0011] FIG. 1A is a diagram showing an example of a hardware configuration of a virtual machine 100 in this embodiment. The virtual machine 100 is configured on a cloud server, and mainly includes a CPU 101, a ROM 102, a RAM 103, and an interface 104. These are connected to each other via a bus 105. The virtual machine 100 is an example of an information processing device. A central processing unit (CPU) 101 controls the entire virtual machine 100. The CPU 101 executes the processing of a flowchart described later and various functions by reading and executing a program stored in the ROM 102 or the like. A read only memory (ROM) 102 stores a program executed by the CPU 101 and an instruction table 204 (FIG. 2). A random access memory (RAM) 103 functions as a working area for the CPU 101, and also temporarily stores data used during program execution.

[0012] The interface 104 is a network interface for connecting to the gateway 201 (FIG. 2). The interface 104 may also have a function for connecting to a display device that displays data stored in the ROM 102 or data supplied from the outside, or an input device for inputting data in response to a user's operation. The virtual machine 100 may also have a virtually installed hard disk, memory card, etc. The virtual machine 100 may also access virtually removable external storage devices including optical disks such as flexible disks (FDs) and compact disks (CDs), magnetic or optical cards, IC cards, memory cards, etc., to input and output data.

[0013] 1B is a diagram showing an example of the hardware configuration of communication terminal 110 and Web server 120 in this embodiment. Communication terminal 110 is a terminal device on which a user browses and operates a screen, such as a PC (personal computer) or a tablet terminal. Note that communication terminal 110 may also be an MFP (multi function peripheral). Web server 120 is a server device that stores Web pages. Below, the same configurations of communication terminal 110 and Web server 120 will be described for communication terminal 110, and a description of Web server 120 will be omitted.

[0014] The communication terminal 110 mainly comprises a CPU 111, a ROM 112, a RAM 113, a HDD 114, an interface 115, and a touch panel 116. These are connected to each other via a bus 117. The CPU 111 controls the entire device. The CPU 111 executes the processes of the flowcharts described below and various functions by reading and executing programs stored in the ROM 112 and the like. The ROM 112 stores the programs executed by the CPU 111. The RAM 113 functions as a working area for the CPU 111 and also temporarily stores data used during program execution. The HDD 114 stores various data, setting information, and the like. The HDD 114 of the Web server 120 also has a database that stores Web pages.

[0015] The interface 115 is a network interface for connecting to a network such as the Internet. The interface 115 of the communication terminal 110 also connects to peripheral devices such as a scanner and a printer. The communication terminal 110 executes scanning and printing under the control of the CPU 111. Touch panel 116 has both a screen display function and a user operation input function. Under the control of CPU 101, communication terminal 110 displays the drawing result of a Web page on touch panel 116 of communication terminal 110. Touch panel 116 of communication terminal 110 is an example of a display unit. Hereinafter, touch panel 116 of communication terminal 110 is referred to as a screen. The drawing result of a Web page includes display items (buttons, input fields, etc.) that accept input operations from a user. Touch panel 116 is equipped with a touch sensor. When a touch operation by a user's finger or the like is detected, a signal detected by the touch sensor is processed by a program for the touch sensor stored in ROM 112, and the touched position is calculated as coordinate information on touch panel 116. Furthermore, a sound output device (not shown) and an LED lamp (not shown) are built into the communication terminal 110. The communication terminal 110 executes sound output and lighting of the LED lamp under the control of the CPU 101.

[0016] Next, an example of the overall configuration of the information processing system according to this embodiment will be described with reference to FIG. 2. In this system, an image generation system 200 consisting of a virtual machine 100 and a gateway 201, a communication terminal 110, and a Web server 120 can communicate with each other via a network. The image generation system 200 is a cloud system that acquires a Web page from the Web server 120 in response to a request from the communication terminal 110, and generates image data as a rendering result of the acquired Web page. When the image generation system 200 transmits the rendering result of the Web page to the communication terminal 110, the communication terminal 110 displays the rendering result received from the image generation system 200 on a screen. Furthermore, when the communication terminal 110 detects a touch operation on the screen on which the rendering result is displayed, the communication terminal 110 transmits coordinate information of the touched position to the image generation system 200.

[0017] The gateway 201 is connected to a network such as the Internet, and controls communication between the communication terminal 110 and the virtual machine 100, and communication between the Web server 120 and the virtual machine 100. In the example of Fig. 2, the image generation system 200 is configured with one virtual machine 100, but may be configured with multiple virtual machines by arranging a load balancer to enable load distribution.

[0018] The virtual machine 100 performs processing to interpret the Web page received from the Web server 120, and transmits the processing result to the communication terminal 110. In this embodiment, the virtual machine 100 has the functions of a browser 202 and a command transmission unit 203. Browser 202 performs processing to interpret the Web page and generates image data (drawing result) to be displayed on the screen of communication terminal 110. In this embodiment, browser 202 acquires an execution command to be transmitted when it is determined that a predetermined operation related to the Web page has been performed on communication terminal 110. Here, browser 202 determines that a predetermined operation has been performed when the display position of a predetermined element included in the Web page is pressed. The predetermined element here refers to an element to which a predetermined attribute such as a disable attribute or a readonly attribute has been assigned,< / button> <button>Elements and <input> The coordinate information is an element of a user interface such as a user interface element. When the browser 202 receives coordinate information from the communication terminal 110, the browser 202 compares the received coordinate information with the coordinate information of a predetermined element to determine whether or not a predetermined operation has been performed. When it is determined that a predetermined operation has been performed, the browser 202 acquires an execution command associated with the predetermined operation. The contents of the operation and the contents of the execution command are associated with each other by the command table 204. The browser 202 reads the command table 204 stored in the ROM 102 and acquires an execution command associated with the contents of the operation. After that, the command transmission unit 203 performs a process of transmitting the execution command before the browser 202 performs a process of generating a rendering result. That is, the virtual machine 100 transmits the command information with priority over the rendering result of the Web page.

[0019] Next, the flow of processing executed in the information processing system will be described. Fig. 3 is a flowchart showing the flow of processing in communication terminal 110 according to this embodiment. The processing in the flowchart in Fig. 3 is realized by CPU 111 of communication terminal 110 reading a program stored in ROM 112 into RAM 113 and executing it. In the following description, each process (step) is represented by adding an S to the beginning, and the representation of the process (step) will be omitted. The processing contents shown in the flowchart start, for example, when a user inputs the URL of a web page that he or she wishes to view.

[0020] First, in S301, the communication terminal 110 transmits the input URL of the Web page to the virtual machine 100. Then, in S302, the communication terminal 110 displays the rendering result of the Web page received from the virtual machine 100. As a result, the user interface (display items) included in the Web page are displayed on the screen. Note that the Web page of this embodiment includes a video. Next, in S303, the communication terminal 110 determines whether or not to end the screen display. If the communication terminal 110 determines to end the screen display, it transmits a display end instruction to the virtual machine 100, and the process of this flowchart ends. If the communication terminal 110 determines not to end the screen display, the process proceeds to S304. In S304, the communication terminal 110 determines whether or not the screen has been pressed by the user. If the communication terminal 110 determines that the screen has been pressed (Yes in S304), the communication terminal 110 calculates coordinate information of the pressed position and transmits it to the virtual machine 100 (S305). On the other hand, if the communication terminal 110 determines that the screen has not been pressed (No in S304), the process proceeds to S306.

[0021] Next, in S306, the communication terminal 110 determines whether or not information has been received from the virtual machine 100. If the communication terminal 110 determines that information has been received (Yes in S306), the communication terminal 110 determines whether or not the information is an execution command (S307). On the other hand, if the communication terminal 110 determines that information has not been received (No in S306), the process returns to S304. Next, when it is determined in S307 that the information received by communication terminal 110 is an execution command (Yes in S307), communication terminal 110 performs processing according to the execution command (S308). For example, communication terminal 110 uses a sound output device to generate a sound. On the other hand, if the communication terminal 110 determines in S307 that the received information is not an execution command (No in S307), the communication terminal 110 determines that the information is a rendering result of a Web page, and the process returns to S302. In this embodiment, the next frame of the video is displayed on the screen.

[0022] According to the above-described processing of the communication terminal 110, when a user performs a specific operation on a Web page, the processing corresponding to the operation is promptly executed without waiting for the screen display to be updated. In other words, when using a cloud browser, delays in the response corresponding to the operation are suppressed, and the user is not confused.

[0023] Fig. 4 is a flowchart showing the flow of processing of the virtual machine 100 according to this embodiment. The processing of the flowchart in Fig. 4 is realized by the CPU 101 of the virtual machine 100 reading a program stored in the ROM 102 into the RAM 103 and executing it. First, in S 401 , the virtual machine 100 receives a URL from the communication terminal 110 . Next, in S402, the virtual machine 100 acquires the web page of the URL received in S401 from the web server 120. Here, the web page includes HTML documents, JavaScript (registered trademark), CSS files, external fonts, images, videos, etc. The virtual machine 100 transmits to the communication terminal 110 the rendering result of the web page indicated by the URL received from the communication terminal 110. Next, in S403, the virtual machine 100 performs processing to interpret the Web page acquired in S402. The virtual machine 100 acquires information indicating an operation on the communication terminal 110 for the Web page transmitted to the communication terminal 110, and determines processing based on the information. For example, the virtual machine 100 determines whether or not the rendering of the Web page needs to be updated based on the information indicating the operation on the communication terminal 110. Next, in S404, the virtual machine 100 determines whether or not it has received coordinate information (position information) indicating the pressed position on the screen from the communication terminal 110. If it has determined that the virtual machine 100 has received the coordinate information (Yes in S404), the virtual machine 100 determines whether or not a predetermined operation has been performed on the communication terminal 110 based on the received coordinate information (S405). On the other hand, if it has determined that the virtual machine 100 has not received the coordinate information (No in S404), the process proceeds to S407.

[0024] The process of S405 will now be described in detail with reference to an example Web page shown in Fig. 5. Fig. 5(A) is a diagram showing an example of a description of an HTML file constituting a Web page. Fig. 5(B) is a diagram showing the rendering result generated when the HTML file of Fig. 5(A) is processed. The rendering result of Fig. 5(B) includes two buttons 511 and 512, and a video area 513 in which a video is played. The description code 501 in FIG. 5(A) is a code with the disable attribute.< / button> <button> The element corresponds to the button 511 in FIG. 5B. The description code 502 in FIG. 5A does not have the disable attribute.< / button> <button>The description code 503 in FIG. 5(A) is <video>5B.

[0025] 6 shows an example of the command table 204. In the command table 204, "Web page process" indicating operation content 601 related to a Web page is associated with "Device API" indicating command information 602 executable by the communication terminal 110. For example, since "Push disable element" is associated with "beep01()", it can be seen that when a user presses a display item based on an element to which a disable attribute is assigned, a sound (beep01) is generated in the communication terminal 110. That is, when the virtual machine 100 detects a press on an element for which pressing is not valid in the communication terminal 110, the virtual machine 100 instructs the communication terminal 110 to perform a process of outputting a sound (beep01) indicating an error. In the example of FIG. 5, when a user presses a button 511 on the screen, a sound is generated from the communication terminal 110. Similarly, since "Push readonly element" and "beep02()" are associated, it can be seen that when the user presses a display item based on an element to which the readonly attribute has been assigned, a sound (beep02) will sound on the communications terminal 110. That is, when the virtual machine 100 detects a press on an element for which only reading is permitted on the communications terminal 110, the virtual machine 100 instructs the communications terminal 110 to perform a process of outputting a sound (beep02) indicating an error. Note that the command information 602 is not limited to sounding a sound, and may be, for example, turning on a light, as long as it is an execution command that can be executed by the communications terminal 110.

[0026] Returning to the description of FIG. 4, in S405, the virtual machine 100 determines whether or not an operation to be registered in the command table 204 has been performed. In the examples of FIGS. 5 and 6, the virtual machine 100 determines whether or not the button 511 has been pressed. If the virtual machine 100 determines that an operation to be registered in the command table 204 has been performed (Yes in S405), it is determined that a predetermined operation has been performed, and the virtual machine 100 acquires an execution command associated with the operation from the command table 204. In the examples of FIGS. 5 and 6, the virtual machine 100 acquires the execution command "beep01( )". Thereafter, the virtual machine 100 transmits the acquired execution command to the communication terminal 110 (S406). In this case, in the processing flow of the communication terminal 110, the information received in S307 is determined to be a command to be executed, and the execution command "beep01( )" is executed in S306.

[0027] In this embodiment, the virtual machine 100 transmits an execution command to the communication terminal 110, but may transmit the element name pressed by the user and the attribute assigned to the element name as command information to the communication terminal 110. In this case, the communication terminal 110 determines whether or not there is a command to be executed based on the received command information, and executes the command if there is a command to be executed. A command table stored on the communication terminal 110 side is used to determine whether or not there is a command to be executed.

[0028] Next, in S407, the virtual machine 100 determines whether the interpretation process of the Web page has ended. If the virtual machine 100 determines that the interpretation process has ended (Yes in S407), the virtual machine 100 generates a rendering result of the Web page (S408) and transmits the rendering result to the communication terminal 110 (S409). The virtual machine 100 updates the rendering of the Web page in response to the operation indicated by the information indicating the operation on the communication terminal 110 for the Web page. In this case, in the processing flow of the communication terminal 110, the rendering result of the Web page is displayed on the screen in S302. That is, the virtual machine 100 transmits the updated rendering result to the communication terminal 110. On the other hand, if the virtual machine 100 determines that the interpretation process has not ended (No in S407), the processing returns to S403. In this way, the virtual machine 100 obtains information indicating the operation on the communication terminal 110 for the Web page, and transmits an instruction for processing to the communication terminal 110 in response to the operation, prior to transmitting the rendering result of the updated Web page. Next, in S410, the virtual machine 100 determines whether or not a display end instruction has been received from the communication terminal 110. If the virtual machine 100 determines that a display end instruction has been received (Yes in S410), the process of this flowchart ends. If the virtual machine 100 determines that a display end instruction has not been received (No in S410), the process returns to S403.

[0029] According to the first embodiment described above, a command to be executed by the communication terminal 110 is notified to the communication terminal 110 prior to the rendering result of the Web page. As a result, when a user presses a specific button, for example, a sound is generated without waiting for the next frame of a moving image to be displayed, and the user can be promptly notified that the specific button cannot be pressed. That is, when a user operates the screen of the communication terminal 110, the virtual machine 100 can display a screen and output a sound as if the user were operating a browser built into the communication terminal 110. This can improve the user's convenience when using a browser on the cloud.

[0030] <Second embodiment> In the above-described first embodiment, an example was described in which, when the virtual machine 100 acquires an execution command executable by the communication terminal 110, the execution command is immediately transmitted to the communication terminal 110. Here, when the communication band connecting the communication terminal 110 and the image generating system 200 is tight, it is necessary to transmit execution commands that do not allow delays preferentially. For example, if the sound generated when the user operates the user interface of a Web page is delayed, the user is often confused. On the other hand, even if it takes several hundred ms (milliseconds) from when the user presses the print execution button in the Web page until printing starts, the user is unlikely to be confused. Therefore, in the second embodiment, an example is described in which an instruction that needs to be linked to a user's operation is transmitted preferentially over an instruction that does not need to be linked to a user's operation. The configuration in this embodiment is the same as that in FIG. 1A, FIG. 1B, and FIG. 2. Also, the processing flow of the communication terminal 110 executed in this embodiment is the same as that in FIG. 3. Therefore, in this embodiment, the description of the same parts as in the first embodiment is omitted.

[0031] Fig. 7 is a flowchart showing the flow of processing of the virtual machine 100 according to this embodiment. Note that the flowchart in Fig. 7 is a flowchart in which S406 in Fig. 3 is replaced with S701 to S703. Therefore, only S701 to S703 will be described, and descriptions of other processes (steps) will be omitted. First, a specific explanation will be given by showing an example of a Web page in FIG. 8. FIG. 8(A) is a diagram showing an example of a description of an HTML file that constitutes a Web page. FIG. 8(B) is a diagram showing the rendering result that is generated when the HTML file of FIG. 8(A) is processed. The rendering result of FIG. 8(B) is the same as that of FIG. 5(B). The difference between FIG. 8(A) and FIG. 5(A) is that description code 502 has been replaced with description code 801. Description code 801 in FIG. 8(A) has "print()" registered in the event handler.< / video> < / button> <button>8B. Button 512 is a print execution button for instructing communication terminal 110 to execute printing.

[0032] Next, an example of the command table 204 is shown in Fig. 9. The first difference between Fig. 9 and Fig. 6 is that data associating "Perform print()" with "print()" has been added. With the addition of this data, when the user presses the print execution button, printing is executed by the communication terminal 110. Here, if there is a delay between the user's button operation and the sound being emitted, the user will often be confused. That is, the sound being emitted is a process that needs to be linked to the user's operation. An execution command for such a process is referred to as first command information. Examples of the first command information include the emission of a sound and the turning on of a light. On the other hand, even if there is a delay between the user pressing the print execution button and the start of printing execution, the user will rarely be confused. That is, printing is a process that does not need to be linked to the user's operation. An execution command for such a process is referred to as second command information. Examples of the second command information include scanning, changing the settings of the communication terminal 110, and the like, in addition to printing.

[0033] 9 and 6 is that an item "Delay" indicating a delay time 901 is further associated. The delay time 901 is time information for specifying the time from when an execution command is acquired to when it is transmitted. For example, when "Delay" is specified as 0 ms, the virtual machine 100 transmits the execution command immediately after acquiring it. When "Delay" is specified as 500 ms, the virtual machine 100 transmits the execution command 500 milliseconds after acquiring it. In this embodiment, the delay time 901 of the first command information is set shorter than the delay time 901 of the second command information. That is, the virtual machine 100 transmits the first command information with priority over the second command information. Note that the information set in the command table 204 is not limited to the delay time 901, as long as it is information that can determine the transmission order when there are multiple pieces of command information to be transmitted.

[0034] First, in S701, the virtual machine 100 registers in a timer a command transmission job, which is a job for transmitting an execution command obtained from the command table 204. Here, the virtual machine 100 obtains the delay time 901 of the execution command from the command table 204 and registers it in the timer. For example, since "Perform print()" has a "Delay" of 500 ms, it is registered so that the execution command "print()" is transmitted after 500 milliseconds have elapsed. Next, in S702, the virtual machine 100 determines whether the elapsed time from the registration of the command transmission job has reached the specified time. If it is determined that the elapsed time has reached the specified time (Yes in S702), the virtual machine 100 executes the corresponding command transmission job (S703), and the process then proceeds to S407. On the other hand, if it is determined that the elapsed time has not reached the specified time (No in S702), the process proceeds to S407.

[0035] According to the second embodiment described above, when an execution command that needs to be linked to a user's operation and an execution command that does not need to be linked to a user's operation occur almost simultaneously, the execution command that needs to be linked can be transmitted preferentially over the execution command that does not need to be linked. Therefore, even if the communication band connecting the communication terminal 110 and the image generating system 200 is congested, when the user presses a specific button on the communication terminal 110, a sound is generated without delay, and the user can be promptly notified that the specific button cannot be pressed. That is, similar to the first embodiment, the convenience of the user when using a browser on the cloud can be improved.

[0036] As a modification of the second embodiment, the drawing generation process (S408) is started after the specified time has elapsed in Fig. 7, but it may be started simultaneously with the timer registration of the command transmission job or after a predetermined time has elapsed since the timer registration. This makes it possible to transmit the drawing result to the communication terminal 110 as soon as possible.

[0037] Although the present invention has been described above with reference to each embodiment, the above-mentioned embodiments are merely illustrative examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these embodiments. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

[0038] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0039] 100: Virtual machine 100: Communication terminal, 120: Web server, 200: Image generating system, 202: Browser, 203: Command transmission unit, 204: Command table< / button>

Claims

1. An information processing device capable of communicating with a communication terminal, a first transmission means for transmitting a rendering result of the web page to the communication terminal; an acquisition means for acquiring information indicating an operation on the communication terminal with respect to the rendering result of the Web page transmitted by the first transmission means; a second transmission means for updating a drawing on the Web page in response to an operation indicated by the information acquired by the acquisition means, and transmitting the updated drawing result to the communication terminal; a third transmission means for transmitting, when the operation indicated by the information acquired by the acquisition means is an operation on a predetermined item displayed on the Web page, command information resulting from the operation being executed on the predetermined item to the communication terminal; When the operation indicated by the information acquired by the acquisition means is an operation for the predetermined item displayed on the Web page, the third transmission means transmits the command information to the communication terminal in priority to the transmission of the updated drawing result by the second transmission means, and the second transmission means transmits the updated drawing result to the communication terminal after the transmission of the command information by the third transmission means.

23. An information processing apparatus comprising:

2. The command information is information instructing the execution of a process that needs to be executed in conjunction with an operation on the specified item.

2. The information processing apparatus according to claim 1,

3. The command information is information instructing the execution of sound emission or light illumination.

3. The information processing apparatus according to claim 2.

4. The predetermined item is a display item based on a <button> element or an <input> element to which a disable attribute or a readonly attribute is assigned in the Web page.

4. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises:

5. The information acquired by the acquisition means includes position information regarding an operation on the rendering result of the Web page in the communication terminal, The information processing device further includes a determination unit that determines whether an operation has been performed on the predetermined item based on position information regarding an operation on the drawing result of the Web page and position information of the predetermined item included in the Web page.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: a first input section;

6. A method for controlling an information processing device capable of communicating with a communication terminal, comprising: a first transmission step of transmitting a rendering result of the web page to the communication terminal; an acquiring step of acquiring information indicating an operation on the communication terminal with respect to the rendering result of the Web page transmitted in the first transmitting step; a second transmission step of updating a drawing on the Web page in response to an operation indicated by the information acquired in the acquisition step, and transmitting the updated drawing result to the communication terminal; a third transmission step of transmitting, when the operation indicated by the information acquired in the acquisition step is an operation on a predetermined item displayed on the Web page, command information resulting from the operation being executed on the predetermined item to the communication terminal; When the operation indicated by the information acquired in the acquisition step is an operation for the predetermined item displayed on the Web page, the command information is transmitted to the communication terminal in the third transmission step in priority to the transmission of the updated drawing result in the second transmission step, and the updated drawing result is transmitted to the communication terminal in the second transmission step after the transmission of the command information in the third transmission step.

23. A method for controlling an information processing apparatus comprising:

7. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 5.

Images