Information processing device, control method for information processing device, and program

Abstract

This technology reduces the amount of data transmitted when rendering web content, including videos, using a cloud-based web browser. [Solution] An information processing device having a cloud browser function, comprising: acquisition means for acquiring web content in response to a request from another information processing device; rendering means for rendering the web content and converting it into an image; analysis means for analyzing the video contained in the web content; generation means for generating timeline information describing the display order of a series of images converted by the rendering means based on the analysis results by the analysis means; and transmission means for transmitting the timeline information and the series of images to the other information processing device.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a control method for the information processing apparatus, and a program.

Background Art

[0002] Conventionally, when displaying Web content stored on a Web server on a client device such as a PC, smartphone, or device, it is often the case to use a Web browser on the client device. At this time, for the purpose of visual effects, it is also common to display a video in the Web content. For example, in a small printer, expressions such as emphasizing an error display when a failure occurs by blinking an icon or displaying a recovery procedure as an animation are often used.

[0003] However, depending on the client device, due to limited resources, it may not be possible to play a video on the Web browser. Therefore, Patent Document 1 discloses converting Web content including a video so that it only includes still images and performing rendering.

[0004] In addition, in a client device such as a small printer with limited resources, it may not be possible to operate the Web browser itself. In order to display Web content on such a client device, Web browser technologies such as a cloud-type Web browser that executes rendering processing on a cloud server or RBI (Remote Browser Isolation) are provided. With such rendering technology, the client device can acquire the rendering result as an image via the network and display the rendering result on a screen such as a display device.

[0005] When web content in a cloud-based web browser consists only of static objects, the rendering result is a still image that does not change over time. Therefore, once a client device obtains the rendering result from the cloud server, it can use the same rendering result to display content until the user requests rendering of new web content. [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2013-13016 [Overview of the Initiative] [Problems that the invention aims to solve]

[0007] However, when web content includes dynamic objects such as animated GIFs, the rendering result changes over time, requiring the client device to repeatedly retrieve and display the rendering result. In particular, if a loop is specified for displaying dynamic objects within the web content, the rendering result will change for each loop iteration. As a result, the client device must continuously retrieve the rendering result used for display from the cloud server, which increases the amount of data transmitted and can strain network bandwidth and increase the CPU load on the client device.

[0008] This invention has been made in view of the above-mentioned problems, and aims to provide a technology that reduces the amount of rendering data transmitted when rendering web content, including video, using a cloud-based web browser. [Means for solving the problem]

[0009] The information processing apparatus according to the present invention, which achieves the above objectives, An information processing device having a cloud browser function, A means for acquiring web content in response to requests from other information processing devices, A rendering means for rendering the aforementioned web content and converting it into an image, An analysis means for analyzing the video contained in the aforementioned web content, A generation means generates timeline information describing the display order of a series of images converted by the rendering means, based on the analysis results by the analysis means. A transmission means for transmitting the timeline information and the series of images to the other information processing device, It is characterized by being equipped with [the following features]. [Effects of the Invention]

[0010] According to the present invention, when rendering web content including video using a cloud-based web browser, the amount of rendering result data transmitted can be reduced. [Brief explanation of the drawing]

[0011] [Figure 1] A diagram showing an example configuration of an information processing system according to the first embodiment. [Figure 2] A flowchart showing the overall flow of processing performed by the rendering processing device according to the first embodiment. [Figure 3] A flowchart showing the detailed processing flow of the rendering process performed by the rendering processing device according to the first embodiment. [Figure 4] A flowchart showing the flow of display processing performed by the client device according to the first embodiment. [Figure 5] A diagram showing an example of a timestamp description according to the first embodiment. [Figure 6] (A) A diagram showing an example of the structure of transmitted data according to the first embodiment, (B) A diagram showing an example of the structure of transmitted data according to the second embodiment, and (C) A diagram showing an example of the structure of transmitted data according to the third embodiment. [Figure 7] A diagram showing an example of web content description according to the first embodiment. [Figure 8] A diagram showing a configuration example of an information processing system according to the second embodiment. [Figure 9] A flowchart showing the detailed processing flow of the rendering process performed by the rendering processing device according to the second embodiment. [Figure 10] A flowchart showing the flow of display processing performed by the client device according to the second embodiment. [Figure 11] A diagram showing a configuration example of an information processing system according to the third embodiment. [Figure 12] A flowchart showing the detailed processing flow of the rendering process performed by the rendering processing device according to the third embodiment. [Figure 13] A flowchart showing the flow of display processing performed by the client device according to the third embodiment.

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0013] (First Embodiment) <Configuration of Information Processing System> FIG. 1 is a diagram showing a configuration example of the information processing system according to the present embodiment. The information processing system includes a rendering processing device 100, a client device 120, a display device 130, and a Web server 140. The rendering processing device 100, the client device 120, and the Web server 140 are connected to a network such as a LAN or the Internet and are configured to be able to perform data communication with each other.

[0014] The rendering processing unit 100 has a cloud browser function and receives requests sent from the client device 120 and executes the corresponding processing. Examples of the rendering processing unit 100 include a PC, a server, and cloud computing services such as an AWS account provided by AWS (Amazon Web Services).

[0015] The rendering processing unit 100 includes a CPU 101 and a memory 102. The CPU 101 controls the operation of the entire rendering processing unit 100. The memory 102 provides a workspace used by the CPU 101 when executing various processes. Of the processing units constituting the rendering processing unit 100, each processing unit except for the CPU 101 and memory 102 may be configured in hardware or in software.

[0016] In this embodiment, the rendering processing unit 100, the client device 120, the display device 130, and the web server 140 are described as separate devices, but several of these may be configured as the same device. For example, the client device 120 and the display device 130 may be configured as the same device. Also, the rendering processing unit 100 and the web server 140 may be configured as the same device.

[0017] The rendering processing device 100 comprises a rendering unit 103, a video analysis unit 104, a timeline generation unit 105, a data creation unit 106, and a data transmission unit 107. The rendering unit 103 acquires web content from the web server 140, renders the acquired web content, and generates an image (a still image such as JPEG) as the rendering result. The video analysis unit 104 analyzes the video information contained in the web content and acquires information on the video's playback time and loop count. The timeline generation unit 105 generates timeline information if the web content contains video. The timeline information describes the display order of a series of images obtained by converting the rendering result of the web content. The timeline generation unit 105 generates timeline information, for example, based on the video's playback time and loop count. The data creation unit 106 adds the rendering result (still image, series of images, and / or timeline information) to a transmission buffer on memory 102. The data transmission unit 107 transmits the data stored in the transmission buffer to the client device 120. The data transmission unit 107 archives, for example, timeline information and a series of images and sends them to the client device 120. Alternatively, the data transmission unit 107 sends rendering results to the client device 120 sequentially each time an image is created.

[0018] The client device 120 connects to the rendering processing device 100 and requests the rendering processing device 100 to render web content stored on the web server 140 using a communication protocol such as HTTP. There may be multiple client devices 120, each assigned a different network address. Examples of client devices 120 include PCs, tablets, smartphones, and printers.

[0019] The client device 120 includes a CPU 121 and memory 122. The CPU 121 controls the operation of the entire client device 120. Memory 122 provides a workspace used by the CPU 121 when executing various processes. Of the processing units that make up the client device 120, each processing unit except for the CPU 121 and memory 122 may be configured in hardware or in software.

[0020] The client device 120 includes a data receiving unit 123, an image selection unit 124, and an image display control unit 125. The data receiving unit 123 receives data transmitted from the rendering processing unit 100. The image selection unit 124 selects and reads still images from the receiving buffer that correspond to the timestamps matched on the timeline. The image display control unit 125 controls the display device 130 to display the still images selected and read by the image selection unit 124.

[0021] The display device 130 is connected to the client device 120 and can display images transmitted from the client device 120. The web server 140 transmits web content in response to requests from the rendering processing device 100. Examples of the web server 140 include a PC, a server, and a cloud computing service.

[0022] <Processing by the rendering device> Next, the processing flow performed by the rendering processing device 100 according to this embodiment will be explained using the flowchart in Figure 2.

[0023] In S201, the rendering processing unit 100 receives a request from the client device 120 to display web content specified by a URL. In S202, the rendering unit 103 retrieves the web content from the web server 140 based on the received display request. In the case of web content written in HTML, videos are defined using video tags (for mp4, etc.) or img tags (for animated GIFs, etc.). Here, Figure 7 shows an example of web content written in HTML, where an img tag 701 defines a reference to an animated GIF.

[0024] In S203, the video analysis unit 104 determines whether or not the web content contains video. If this step is Yes, the process proceeds to S204. On the other hand, if this step is No, the process proceeds to S207.

[0025] In S204, the video analysis unit 104 obtains information on the number of loops and playback time for all videos included in the web content. If the video format is mp4, the number of loops can be obtained by referring to the loop attribute of the video tag. If the video format is animated GIF, the number of loops can be obtained by referring to the loop attribute in the file. If the video format is mp4, the playback time can be obtained by referring to the duration attribute in the file. If the video format is animated GIF, the playback time can be obtained by referring to the delay time attribute in the file.

[0026] In S205, the video analysis unit 104 obtains information on the longest playback time among all videos (hereinafter also referred to as the unit playback time of the entire rendering result, or simply "unit playback time"). The video analysis unit 104 also obtains information on the largest number of loops among all videos (hereinafter also referred to as "maximum number of loops").

[0027] Subsequently, in S206, the rendering unit 103 performs rendering of the web content. Details of this process will be described later with reference to Figure 3. In S207, the rendering unit 103 renders the web content and generates a still image (such as JPEG) as the rendering result. In S208, the data transmission unit 107 transmits the rendering result to the client device 120. The above is the series of processes shown in Figure 3.

[0028] Next, referring to the flowchart in Figure 3, we will explain the detailed processing flow of the rendering process at S206 in Figure 2. At S301, the timeline generation unit 105 writes the maximum number of loops to the timeline. At S302, the rendering unit 103 starts the rendering process of the web content.

[0029] In S303, the rendering unit 103 saves the rendering result as a still image to a file each time the rendering result changes over time. In this embodiment, the rendering unit 103 is assumed to be the open-source WebKit, but other implementations may also be used.

[0030] Next, the processes S303 to S307 are repeated for the duration of the unit playback time. In S304, within the repeated process of S303, the data transmission unit 107 transmits the rendering result to the client device 120. That is, the data transmission unit 107 sequentially transmits the image converted by the rendering unit 103 to the client device 120 each time a conversion is performed.

[0031] In S305, the timeline generation unit 105 adds the relative time from the rendering start time in S302 and the identifier of the still image which is the rendering result to the timeline. That is, the timeline information includes the relative time from the rendering start by the rendering unit 103 and the identifier of the image corresponding to that relative time.

[0032] In S306, the data creation unit 106 adds the rendering result, a still image, to the transmission buffer in memory 102.

[0033] In S307, the rendering unit 103 waits for the duration of the repetition time interval. After that, it returns to S303, which is the beginning of the next repetition. Here, the repetition time interval is determined based on the CPU processing capacity of the rendering processing unit 100 and the client device 120, network performance, etc. For example, if the client device 120 can display one image every 500 msec, the time interval is set to 500 msec. In this embodiment, the explanation assumes a time interval of 500 msec, but the time interval may be determined using other criteria.

[0034] After the iterative process is completed, in S308, the data creation unit 106 adds the timeline information to the transmission buffer.

[0035] In S309, the data transmission unit 107 transmits the data stored in the transmission buffer to the client device 120. Here, the data transmission unit 107 archives the created timeline information and a series of rendering results (still images) rendered during video playback within the unit playback time included in the Web content, and transmits them to the client device 120. The number of images transmitted at this time may be determined according to the performance of the client device 120 and / or the performance of the communication network. For example, if the number of images in the series is 30 and the number of images to be transmitted at once is 10, the transmission may be performed in three separate transmissions. In that case, the first transmission would include the timeline information and 10 images, while the second and third transmissions would only include the 10 images (the transmission of timeline information is not required).

[0036] Subsequently, in S310, the rendering unit 103 finishes rendering the web content. This completes the rendering process flow.

[0037] <Example of a timeline description> Next, with reference to Figure 5, an example of describing the timeline in this embodiment in CSV format will be explained. In this example, the number of loops is written numerically in row 501. In particular, if "INFINITE" is written instead of a number, it indicates that the display will loop indefinitely.

[0038] Line 502 contains the relative time (in seconds) from the start of rendering and the identifier of the rendering result stored in the send buffer, separated by a comma. In the example in Figure 5, when the relative time is 0.0, the rendering result is result0.jpg; when the relative time is 0.1, the rendering result is result1.jpg; and when the relative time is 0.2, the rendering result is result2.jpg.

[0039] <Example of data structure stored in the transmit buffer> Figure 6(A) shows an example of the data structure stored in the transmission buffer. In this embodiment, the data is stored in ZIP format, and it shows that the contents 601 of the timeline described in Figure 5 and the contents 602 of the rendering result in which an identifier is written on the timeline are archived.

[0040] In this embodiment, the ZIP format is assumed as the archive format, but other archive formats may be used. Also, in this embodiment, the timeline and rendering results are saved in the same archive and sent to the client device 120, but they may be sent separately.

[0041] <Processing by the client device> Next, referring to the flowchart in Figure 4, we will explain the processing flow performed by the client device 120 using the data sent to the client device 120 in S309.

[0042] In S401, the data receiving unit 123 receives the data transmitted from the rendering processing device 100 and stores it in the receive buffer in the memory 122.

[0043] In S402, the image selection unit 124 determines whether the received data contains timeline information. If this step is Yes, the process proceeds to S403. If this step is No, the process proceeds to S408. In S403, the image selection unit 124 reads the timeline information.

[0044] Subsequently, the process (processes S404 to S407) is executed repeatedly for the number of loops specified in the timeline. However, if the number of loops is unlimited, the process is repeated until a termination request is received from the user or the application on the client device 120.

[0045] During the iterative process, if the relative time from the start of each loop matches a time written on the timeline, in S405, the image selection unit 124 reads the still image indicated by the identifier written on the same line as the matching time from the receive buffer.

[0046] In S406, the image display control unit 125 outputs the loaded still image to the display device 130 for display. Once all the still images described in the timeline have been displayed, the process returns to S404 and executes the next iteration.

[0047] In S408, the image display control unit 125 outputs image data to the display device 130 for display. This completes the series of processes shown in Figure 4.

[0048] As described above, in this embodiment, during the first loop of the video, the web content is rendered over time, and each time the rendering result changes, the rendering result is converted into an image and sent to the client device 120. As a result, during the first loop, the client device 120 can sequentially display the images.

[0049] Then, based on the analysis results of the video contained in the web content, timeline information describing the display order of the rendered series of images is generated, and the timeline information and the series of images are sent to the client device. That is, after the loop ends, the series of rendering results (series of images) during the loop are sent to the client device 120 along with the timeline information. As a result, in the second and subsequent loops, the client device 120 sequentially selects and displays images from the series of rendering results (series of images) based on the received timeline information. This eliminates the need to continue receiving the same rendering results from the rendering processing device 110.

[0050] Therefore, according to this embodiment, when rendering web content including video using a cloud-based web browser, the amount of rendering result data sent to the client can be reduced. This makes it possible to suppress network bandwidth congestion and increased CPU load on the client.

[0051] (Second embodiment) In the first embodiment, an example was described in which rendering results are each stored in a transmission buffer and sent to the client device 120. However, in the case of web content where the changes in the video are limited, such as blinking a specific icon according to the elapsed time, in a client device with a limited display screen size, the difference between rendering results may be small. Therefore, in this embodiment, an example is described in which multiple rendering results are compressed to reduce the amount of data sent from the rendering processing device 100 to the client device 120.

[0052] <Configuration of the information processing system> Figure 8 shows an example of the configuration of the information processing system according to this embodiment. In this embodiment, the rendering processing device 100 further includes an image compression unit 801 in addition to the components shown in Figure 1. The image compression unit 801 compresses a plurality of rendering results. For example, the image compression unit 801 compresses a series of images converted by the rendering unit 103 based on the display order described in the timeline information. The data transmission unit 107 then transmits the series of images compressed by the image compression unit 801 and the timeline information to the client device 120. In this embodiment, the client device 120 further includes an image decompression unit 821 in addition to the components shown in Figure 1. The image decompression unit 821 decompresses the compressed data received from the rendering processing device 100 to obtain an image.

[0053] <Processing by the rendering device> The overall processing flow performed by the rendering processing device 100 is the same as in Figure 2, so its explanation will be omitted. Next, the detailed processing flow of the rendering process S206 according to this embodiment will be explained with reference to the flowchart in Figure 9. In Figure 9, the processes other than S901 are the same as the processes in Figure 3 of Embodiment 1, so their explanation will be omitted. After the timeline generation unit 105 adds the relative time and image identifier to the timeline (S305), the process proceeds to S901.

[0054] In S901, the image compression unit 801 compresses the rendering result. As an example of a compression encoding method, in this embodiment a method using an inter-frame prediction algorithm such as H.264 is used, but other compression methods may also be used.

[0055] As a result, when the rendering results processed in the previous iterations (S304~S307) are saved as I-frames, the rendering results with the smallest difference are saved as P-frames.

[0056] <Example of data structure in the send buffer> Here, Figure 6(B) illustrates the data structure in the transmit buffer when the timeline and rendering result are encoded in H.264 and then saved in the video format mp4. 611 shows the timeline information stored in the transmit buffer, and 612 shows the rendering result stored in the transmit buffer. In this embodiment, the timeline is assumed to be saved as an H.264 timestamp (PTS), but it may be saved in other formats.

[0057] <Processing by the client device> Next, referring to the flowchart in Figure 10, we will explain the processing flow performed by the client device 120 using the data sent to the client device 120 in S309. The processing other than S1001 is the same as the processing described in Figure 4 of Embodiment 1, so we will omit the explanation.

[0058] In S405, when the image selection unit 124 reads the image corresponding to the relative time from the receive buffer, the process proceeds to S1001. Then, in S1001, the image decompression unit 821 decompresses the image. In this embodiment, HTTP is assumed as the data communication protocol, but streaming protocols such as RTP may also be used.

[0059] As explained above, according to this embodiment, when there is little difference between screens, the data size can be reduced by compression on the time axis. Therefore, the amount of communication can be further reduced.

[0060] (Third embodiment) In the first embodiment, an example was described in which the rendering processing device 100 retransmits the rendering result sent in the first loop iteration by processing S304 to the client device 120 in S309 so that the client device 120 can display it in the second loop iteration and beyond. However, if the client device 120 has sufficient data storage area and can store the rendering result from the first loop iteration in the client device 120, retransmission is unnecessary. Therefore, in this embodiment, an example is described in which the amount of data sent to the client device 120 is reduced by having the client device 120 reuse the rendering result received in the first loop iteration in the second loop iteration and beyond.

[0061] <Configuration of the information processing system> Figure 11 shows an example of the configuration of the information processing system according to this embodiment. The rendering processing device 100 in this embodiment has the same components as those in Figure 1. In addition to the components in Figure 1, the client device 120 in this embodiment further includes an image storage unit 1121. The image storage unit 1121 sequentially saves the rendering results transmitted from the rendering processing device 100 in the first loop. That is, the client device 120 sequentially receives the images obtained by converting the rendering results of the Web content each time a conversion occurs, and the image storage unit 1121 saves the received images. Then, it refers to the image identifier included in the timeline information received from the rendering processing device 100 and selects the image to be displayed from the multiple images stored in the image storage unit 1121.

[0062] <Processing by the rendering device> The overall processing flow performed by the rendering processing device 100 is the same as in Figure 2, so its explanation will be omitted. Next, the detailed processing flow of the rendering process S206 according to this embodiment will be explained with reference to the flowchart in Figure 12. In Figure 12, the processing of S306 in Figure 3 is deleted and not executed, which is a difference from the processes in Figure 3 of Embodiment 1. The other processes are the same as the processes in Figure 3, so their explanation will be omitted.

[0063] <Example of data structure in the send buffer> Figure 6(C) illustrates the data structure when the contents of the timeline shown in Figure 5 are stored in the transmission buffer. In this embodiment, the timeline is assumed to be transmitted in ZIP format, but other formats such as CSV format may also be used.

[0064] <Processing by the client device> Next, referring to the flowchart in Figure 13, we will explain the processing flow performed by the client device 120 using the data sent to the client device 120 in S309. Processing other than S1305 and S1309 is the same as the processing described in Figure 4 of Embodiment 1, so we will omit the explanation.

[0065] If no timeline information exists in S402, the process proceeds to S408, displays the image data, and then proceeds to S1309. In S1309, the image storage unit 1121 saves the image data as a file.

[0066] Furthermore, the process in S1305 is performed instead of the process in S405 shown in Figure 4. In the process in S405, the image selection unit 124 reads images corresponding to relative time from the receive buffer. In contrast, in S1305, the image selection unit 124 reads images corresponding to relative time from the files sequentially saved in the process in S1309.

[0067] As explained above, in this embodiment, if the client device's storage has sufficient capacity, the transmitted rendering results are saved, and only the timeline containing the identifier is transmitted. This further reduces the amount of data transmitted.

[0068] The disclosures herein include the following information processing devices, methods for controlling the information processing devices, and programs.

[0069] (Item 1) An information processing device having a cloud browser function, A means for acquiring web content in response to requests from other information processing devices, A rendering means for rendering the aforementioned web content and converting it into an image, An analysis means for analyzing the video contained in the aforementioned web content, A generation means generates timeline information describing the display order of a series of images converted by the rendering means, based on the analysis results by the analysis means. A transmission means for transmitting the timeline information and the series of images to the other information processing device, An information processing device characterized by comprising: (Item 2) The analysis means analyzes the video to obtain information on the video's playback time and loop count. The information processing device according to item 1, characterized in that the generation means generates the timeline information based on the playback time and the number of loops. (Item 3) The information processing apparatus according to item 1 or 2, characterized in that the timeline information includes the relative time from the start of rendering by the rendering means and an identifier for the image corresponding to the relative time. (Item 4) The system further comprises compression means for compressing the series of images based on the display order described in the timeline information, The information processing apparatus according to item 3, characterized in that the transmission means transmits the series of images compressed by the compression means and the timeline information to the other information processing apparatus. (Item 5) The rendering means is characterized in that it converts the rendering result into an image each time the rendering result changes, as described in any one of items 1 to 4. (Item 6) The information processing apparatus according to any one of items 1 to 5, further characterized in that the transmission means transmits the image converted by the rendering means to the other information processing apparatus sequentially each time it is converted. (Item 7) An information processing device, A receiving means that receives a series of images obtained by converting the rendering result of web content, and timeline information describing the display order of the series of images. A selection means for selecting an image from the series of images based on the timeline information, A display control means for displaying the image selected by the selection means, An information processing device characterized by comprising: (Item 8) The receiving means receives the timeline information and the compressed data of the series of images. The aforementioned information processing device is The information processing apparatus according to item 7, further comprising an image decompression means for decompressing the compressed data. (Item 9) The receiving means further receives the image obtained by converting the rendering result of the web content each time a conversion occurs. The aforementioned timeline information includes the relative time from the start of rendering and the identifier of the image corresponding to that relative time. The aforementioned information processing device is The system further comprises an image storage means for sequentially saving images received by the receiving means, The information processing apparatus according to item 7 or 8, characterized in that the selection means refers to an image identifier included in the timeline information and selects an image to be displayed from a plurality of images stored in the image storage means. (Item 10) A control method for an information processing device having a cloud browser function, A process of acquiring web content in response to requests from other information processing devices, The rendering process involves rendering the aforementioned web content and converting it into an image. An analysis process for analyzing the video contained in the aforementioned web content, A generation step generates timeline information describing the display order of a series of images converted by the rendering step, based on the analysis results from the analysis step. A transmission step of transmitting the timeline information and the series of images to the other information processing device, A control method for an information processing device, characterized by having the following features. (Item 11) A method for controlling an information processing device, A receiving step that receives a series of images obtained by converting the rendering result of web content, and timeline information describing the display order of the series of images. A selection step of selecting an image from the series of images based on the timeline information, A display control step that displays the image selected in the selection step, A control method for an information processing device, characterized by having the following features. (Item 12) A program to cause a computer to execute the control method for the information processing device described in item 10 or 11.

[0070] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0071] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0072] 100: Rendering processing unit, 103: Rendering unit, 104: Video analysis unit, 105: Timeline generation unit, 106: Data creation unit, 107: Data transmission unit, 120: Client device, 123: Data reception unit, 124: Image selection unit, 125: Image display control unit

Claims

1. An information processing device having a cloud browser function, An acquisition means for acquiring web content in response to a request from another information processing device, A rendering means that renders the aforementioned web content and converts it into an image, An analysis means for analyzing the video contained in the aforementioned web content, A generation means generates timeline information describing the display order of a series of images converted by the rendering means, based on the analysis results by the analysis means. A transmission means for transmitting the timeline information and the series of images to the other information processing device, An information processing device characterized by comprising:

2. The analysis means analyzes the video to obtain information on the video's playback time and loop count. The information processing apparatus according to claim 1, characterized in that the generation means generates the timeline information based on the playback time and the number of loops.

3. The information processing apparatus according to claim 1, characterized in that the timeline information includes the relative time from the start of rendering by the rendering means and an identifier for the image corresponding to the relative time.

4. The system further comprises compression means for compressing the series of images based on the display order described in the timeline information, The information processing apparatus according to claim 3, characterized in that the transmission means transmits the series of images compressed by the compression means and the timeline information to the other information processing apparatus.

5. The rendering means is characterized in that it converts the rendering result into an image each time the rendering result changes, as described in claim 1.

6. The information processing apparatus according to claim 1, further characterized in that the transmission means transmits the image converted by the rendering means to the other information processing apparatus sequentially each time it is converted.

7. An information processing device, A receiving means that receives a series of images obtained by converting the rendering result of web content, and timeline information describing the display order of the series of images, A selection means for selecting an image from the series of images based on the timeline information, A display control means for displaying the image selected by the selection means, An information processing device characterized by comprising:

8. The receiving means receives the timeline information and the compressed data of the series of images. The aforementioned information processing device is The information processing apparatus according to claim 7, further comprising an image decompression means for decompressing the compressed data.

9. The receiving means further receives the image obtained by converting the rendering result of the Web content each time a conversion occurs. The aforementioned timeline information includes the relative time from the start of rendering and the identifier of the image corresponding to that relative time. The aforementioned information processing device is The system further comprises an image storage means for sequentially saving images received by the receiving means, The information processing apparatus according to claim 7, wherein the selection means refers to an identifier of an image included in the timeline information and selects an image to be displayed from a plurality of images stored in the image storage means.

10. A control method for an information processing device having a cloud browser function, The acquisition process involves obtaining web content in response to requests from other information processing devices. The rendering process involves rendering the aforementioned web content and converting it into an image. An analysis step for analyzing the video contained in the aforementioned web content, A generation step generates timeline information describing the display order of a series of images converted by the rendering step, based on the analysis results from the analysis step. A transmission step of transmitting the timeline information and the series of images to the other information processing device, A control method for an information processing device, characterized by having the following features.

11. A method for controlling an information processing device, A receiving step that receives a series of images obtained by converting the rendering result of web content, and timeline information describing the display order of the series of images, A selection step of selecting an image from the series of images based on the timeline information, A display control step that displays the image selected in the selection step, A control method for an information processing device, characterized by having the following features.

12. A program for causing a computer to execute the control method of the information processing device described in claim 10 or 11.

Images