Information processing device, control method and program for information processing device

Abstract

We provide technology that enables a consistent display between the cloud browser's drawing section and the device UI. [Solution] An information processing device having a cloud browser function, comprising: a receiving means for receiving a first font list of another information processing device from the other information processing device; a content acquisition means for acquiring content from a web server in response to a request from the other information processing device; a generation means for generating a drawing result based on the content and the first font list; and a transmission means for transmitting the drawing result to the other information processing device.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]

[0002] When an application draws text data, it obtains character shape data from a font. Text data may contain multiple languages, but since different fonts support different languages, it is common for applications to have a font list that indicates the order in which to search for font data and to draw the text data based on that. The type of fonts and font lists available generally differ depending on the environment.

[0003] On the other hand, a technology that uses HTML (https: / / html.spec.whatwg.org) to draw on the screen is known. The application that processes HTML is called a browser, and draws according to the HTML specifications. The browser draws text data based on the HTML specifications and a font list.

[0004] In recent years, it has become possible to run apps on cloud services, allowing users to send their operation information from their own devices to apps on the cloud service, and the device then receives the results of the app's processing and displays them to the user.

[0005] A cloud browser is a browser that runs in the application execution environment of a cloud service. The cloud browser retrieves content from a web server in response to a request from a device, renders the content, and saves the rendering results in a database of the same cloud service. The device retrieves the rendering results from the database and displays them on its screen.

[0006] However, because the UI (user interface) of the device cannot refer to font data that the browser retrieves from an external source based on HTML, the fonts of character strings rendered by the browser and the device UI may differ. In response to this, Patent Document 1 discloses that the browser unifies fonts by sharing font data with the device UI. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Publication No. 2018-014603 Summary of the Invention [Problem to be solved by the invention]

[0008] However, when implementing a cloud browser using the technology described in Patent Document 1, there was a problem in that the cloud browser and the device are in different environments and have different font lists, resulting in different character string displays in the drawing area of ​​the cloud browser and the device UI.

[0009] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a technology for realizing a consistent display between the drawing part of a cloud browser and the device UI. [Means for solving the problem]

[0010] To achieve the above object, an information processing device according to the present invention comprises: An information processing device having a cloud browser function, a receiving means for receiving a first font list of another information processing device from the other information processing device; a content acquisition means for acquiring content from a web server in response to a request from the other information processing device; a generating means for generating a rendering result based on the content and the first font list; a transmitting means for transmitting the drawing result to the other information processing device; The present invention is characterized by comprising: [Effects of the Invention]

[0011] According to the present invention, it is possible to achieve a consistent display between the cloud browser drawing portion and the device UI. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 2 is a schematic diagram showing an example of the configuration of a cloud server according to the first embodiment. [Figure 2] 10 is a flowchart showing an example of processing performed by the cloud server according to the first embodiment. [Figure 3] FIG. 1 is a schematic diagram showing an example of the configuration of a device according to a first embodiment. [Figure 4] 4 is a flowchart showing an example of processing performed by the device of the first embodiment. [Figure 5] FIG. 3 is a diagram showing an example of a font list according to the first embodiment. [Figure 6] FIG. 3 is a diagram showing an example of a font list of the device according to the first embodiment. [Figure 7] FIG. 4 is a diagram showing an example of a font list of a cloud according to the first embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a new font list according to the first embodiment. [Figure 9] FIG. 2 is a diagram showing an example of HTML according to the first embodiment. [Figure 10] FIG. 3 is a diagram showing an example of a font list according to the first embodiment. [Figure 11] 10 is a flowchart showing an example of processing performed by a cloud server according to the second embodiment. [Figure 12] 10 is a flowchart showing an example of processing performed by a device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the claimed invention. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0014] (Embodiment 1) In this embodiment, an example is described in which a cloud server receives a font list of a device from the device, and when drawing content obtained from a web server in response to a request from the device, generates and transmits a drawing result based on the content and the font list of the device.

[0015] <Cloud server configuration> 1 is a configuration diagram showing an overview of a cloud server, which is an information processing device according to this embodiment. A virtual machine is stored in an external storage unit 104 of the cloud server 101, and is loaded into RAM 103 and started up. The cloud server 101 is an information processing device having a cloud browser function.

[0016] The cloud browser runs on a virtual machine and accesses an external web server based on a URL specified via the network connection interface 107 to acquire content that constitutes a web page, and outputs the results of processing the content to the external storage unit 104 as rendering results.

[0017] The CPU 108 is a system control unit that controls the entire device. The ROM 102 stores the control program of the CPU 108 and various fixed data. The RAM 103 is made up of SRAM, DRAM, etc., and is used to store program control variables, etc. Various setting parameters and various work buffers are also stored in the RAM 103. The external storage unit 104 is made up of a hard disk, etc., and is used to store file data such as documents and images.

[0018] The input unit 105 is configured with a keyboard or the like, and is used by an operator to perform various input operations. The network connection interface 107 is an interface for connecting to a network. Connection methods include LAN, USB, etc. Note that when the cloud server 101 is realized by software or the like, each block in FIG. 1 does not necessarily have to be included in the device.

[0019] <Device configuration> 3 is a block diagram showing an outline of a device that is an information processing device according to this embodiment. A tunnel client is executed on the device. Communication with a tunnel server is performed via a network connection interface 307.

[0020] In Fig. 3, CPU 308 is a system control unit that controls the entire device. ROM 302 stores the control program for CPU 308 and various fixed data. RAM 303 is composed of SRAM, DRAM, etc., and is used to store program control variables, etc. Various setting parameters and various work buffers are also stored in RAM 303. External storage unit 304 is composed of a hard disk, etc., and is used to store file data such as documents and images. Input unit 305 is composed of a keyboard, touch panel, etc., and is used by an operator to perform various input operations.

[0021] The display unit 306 is for displaying a UI (user interface) to the user. However, the device 301 may not necessarily be equipped with the display unit 306. In that case, the device 301 may be connected to another display device (not shown) and perform display control to display the UI, etc. on that display device. The network connection interface 307 is an interface for connecting to a network. Connection methods include LAN, USB, etc. The scanner unit 309 is for scanning paper documents. The printer unit 310 is for printing documents, images, etc. Furthermore, when the device 301 is realized by software, etc., each block in FIG. 3 does not necessarily have to be included in the device.

[0022] The information processing system according to this embodiment includes a cloud server 101 and a device 301 .

[0023] <Cloud server processing> The operation of the cloud server 101 in this embodiment will be described below with reference to the flowchart in Fig. 2. In S201, the cloud server 101 receives a command to start a cloud browser via the network connection interface 107 and starts the cloud browser. In S202, the cloud server 101 receives a font list of the device 301 via the network connection interface 107. The font list of the device 301 is saved in RAM 103.

[0024] In S203, the cloud server 101 determines whether the font list of the device 301 stored in RAM 103 is empty. If it is empty (YES in S203), the process proceeds to S206. On the other hand, if it is not empty (NO in S203), the process proceeds to S204. In S204, the cloud server 101 obtains the font list of the cloud from the external storage unit 104 and stores it in RAM 103.

[0025] In S205, cloud server 101 combines the font list of device 301 stored in RAM 103 with the font list of the cloud browser to generate a new font list (list generation). In the new font list, the fonts included in the font list of device 301 are set to have a higher priority than the fonts included in the font list of the cloud browser. For example, the font list of device 301 may look like that shown in FIG. 6, the font list of the cloud browser may look like that shown in FIG. 7, and the new font list may look like that shown in FIG. 8. The fonts written at the top of the file have a higher priority. Fonts are read and processed from top to bottom. The new font list is saved in RAM 103.

[0026] In S206, the cloud server 101 receives the URL via the network connection interface 107. The URL is stored in the RAM 103. In S207, the cloud server 101 acquires content based on the received URL and stores it in the RAM 103 (content acquisition). In this embodiment, the content is HTML.

[0027] In S208, the cloud server 101 determines whether or not a new font list exists in the RAM 103. If a new font list exists (YES in S208), the process proceeds to S209. On the other hand, if a new font list does not exist (NO in S208), the process proceeds to S210.

[0028] In S209, the cloud server 101 adopts the new font list as the font list. In S210, the cloud server 101 adopts the font list of the cloud browser as the font list.

[0029] In S211, the cloud server 101 draws HTML based on the adopted font list. The drawing result is saved in RAM 103. In this embodiment, the drawing result is a JPEG file. Alternatively, the drawing result may be a PNG file. Furthermore, if the HTML itself specifies the font to be used for character string drawing, that font may be drawn with the highest priority in the font list. In other words, if the content specifies the font to be used, the drawing result may be generated based on the specified font. For example, the HTML may look like that shown in Figure 9. MyFont is specified in the CSS font-family. For example, the font list may look like that shown in Figure 10. MyFont.ttf is at the top and is loaded first. Being loaded first means that it has the highest priority.

[0030] In S212, the cloud server 101 transmits the drawing result to the device 301 via the network connection interface 107. The above is the series of processes shown in FIG.

[0031] <Device processing> Next, the operation of the device 301 in this embodiment will be described with reference to the flowchart in Figure 4. In S401, the device 301 acquires its font list from the external storage unit 304, saves it in RAM 303, and references it. The font list is a text file in which font names stored in the external storage unit 304 are used as font information and are arranged according to priority. An example of the text file is shown in Figure 5. Fonts written at the beginning of the file have higher priority, and fonts are read and processed from top to bottom. In this example, FontA.ttf is the font with the highest priority.

[0032] A font list may be provided for each language supported by the device 301. The font list may include, in addition to the font name, metadata such as the supported language, font version, and font size as font information. That is, the font list includes the font name and font metadata. The metadata includes at least one of the supported language of the font, the font version, and the font size. The font list may be in JSON format. The font list may be binary data. If the device 301 does not perform drawing based on the font list, the font list may be empty.

[0033] In S402, the device 301 renders a UI and displays it on the display unit 306. The text in the UI is rendered based on the font list of the device 301. The UI may include the rendering results of the cloud browser in part of the screen.

[0034] In S403, the device 301 receives the URL entered by the user via the input unit 305 and stores it in the RAM 303. In S404, the device 301 transmits a cloud browser startup command to the cloud server 101 via the network connection interface 307. In this embodiment, the startup command is in JSON format and is transmitted by HTTP POST. Alternatively, the startup command may be binary data.

[0035] In S405 , the device 301 acquires the font list of the device 301 from the external storage unit 304 and stores it in the RAM 303 .

[0036] In S406, the device 301 transmits the font list of the device 301 to the cloud server 101 via the network connection interface 307. In this embodiment, the transmission is performed using HTTP POST. In S407, the device 301 obtains the URL stored in RAM 303 and transmits it to the cloud server 101 via the network connection interface 307.

[0037] In S408, the device 301 receives the rendering results via the network connection interface 307 and saves them in the RAM 303. In S409, the device 301 updates the browser display portion of the display unit 306. This allows the rendering results portion from the cloud browser and the built-in UI portion of the device 301 to be displayed with a consistent look. This completes the series of processes shown in Figure 4.

[0038] As described above, in this embodiment, by adjusting the cloud browser, which has a different environment from the embedded UI, to the embedded UI, it is possible to unify the fonts of the cloud browser and the embedded UI even on devices that do not have the resources to download fonts. This makes it possible to unify the display of text between the drawing part of the cloud browser and the device UI.

[0039] (Embodiment 2) In this embodiment, an example will be described in which, if a font of the device 301 is not present on the cloud server 101, the font is uploaded from the device 301 to the cloud server 101 and made available for use.

[0040] The configuration of the information processing system according to this embodiment, and the configuration of each device of the cloud server 101 and the device 301 are the same as those in the first embodiment, and therefore a description thereof will be omitted.

[0041] <Cloud server processing> The operation of the cloud server 101 in this embodiment will be described below with reference to the flowchart in Fig. 11. In Fig. 11, the same processes as those described in Fig. 2 are denoted by the same reference numerals, and the description thereof will be omitted.

[0042] In S1101, the cloud server 101 determines whether the font specified in the font list of the device 301 is present in the external storage unit 104. That is, it determines whether all fonts are present in the external storage unit 104. If present (YES in S1101), the process proceeds to S206. On the other hand, if not present (NO in S1101), the process proceeds to S1102.

[0043] In S1102, the cloud server 101 transmits an upload request for a font that the cloud server 101 does not have to the device 301 via the network connection interface 107. In S1103, the cloud server 101 receives the font via the network connection interface 107 and stores it in the external storage unit 104. Thereafter, the process proceeds to S206. The above is the series of processes in FIG. 11.

[0044] <Device processing> Next, the operation of the device 301 in this embodiment will be described with reference to the flowchart in Fig. 12. In Fig. 12, the same processes as those described in Fig. 4 are denoted by the same reference numerals, and the description thereof will be omitted.

[0045] In S1201, the device 301 receives a request from the cloud server 101 via the network connection interface 307. In S1202, the device 301 determines whether the requested font can be uploaded. For example, the device 301 checks whether a license exists, and if the font can only be used on a licensed device, it can determine that uploading is not permitted. If uploading is permitted (YES in S1202), the process proceeds to S1203. On the other hand, if uploading is not permitted (NO in S1202), the process proceeds to S407.

[0046] In S1203, the device 301 uploads the font to the cloud server 101 via the network connection interface 307. Then, the process proceeds to S407. The above is the series of processes in FIG.

[0047] As described above, according to this embodiment, even if a font of the device 301 is not on the cloud server 101, the font can be made available by uploading it from the device 301 to the cloud server 101.

[0048] The disclosure of this specification includes the following information processing device, control method for an information processing device, and program.

[0049] (Item 1) An information processing device having a cloud browser function, a receiving means for receiving a first font list of another information processing device from the other information processing device; a content acquisition means for acquiring content from a web server in response to a request from the other information processing device; a generating means for generating a rendering result based on the content and the first font list; a transmitting means for transmitting the drawing result to the other information processing device; An information processing device comprising:

[0050] (Item 2) an acquisition means for acquiring a second font list of the information processing device; a list generating means for generating a third font list based on the first font list and the second font list; 2. The information processing device according to item 1, wherein the generating means generates the drawing result based on the content and the third font list.

[0051] (Item 3) a first determination means for determining whether the first font list is an empty list; The information processing device described in item 2 is characterized in that the list generation means generates the third font list based on the first font list and the second font list when the first determination means determines that the first font list is not an empty list.

[0052] (Item 4) The information processing device described in item 3 is characterized in that the generation means generates the drawing result based on the content and the second font list when the first determination means determines that the first font list is an empty list.

[0053] (Item 5) further comprising a second determination means for determining whether the third font list exists; The information processing device described in any one of items 2 to 4 is characterized in that, when the second determination means determines that the third font list exists, the generation means generates the drawing result based on the content and the third font list.

[0054] (Item 6) The information processing device described in any one of items 2 to 5, characterized in that the list generation means generates the third font list so that fonts included in the first font list have a higher priority than fonts included in the second font list.

[0055] (Item 7) 7. The information processing device according to any one of items 2 to 6, wherein the first font list and the second font list each include a font name and font metadata.

[0056] (Item 8) 8. The information processing device according to item 7, wherein the metadata includes at least one of a language supported by the font, a version of the font, and a size of the font.

[0057] (Item 9) The information processing device described in any one of items 1 to 8, characterized in that, when the content explicitly specifies the font to be used, the generation means generates the drawing result based on the explicitly specified font.

[0058] (Item 10) a determining means for determining whether a font in the first font list exists in the information processing device based on the first font list; a request unit that requests the font from the other information processing device when it is determined that the font in the first font list does not exist, 10. The information processing device according to any one of items 1 to 9, wherein the receiving means further receives the font transmitted from the other information processing device in response to a request by the requesting means.

[0059] (Item 11) 11. The information processing device according to any one of items 1 to 10, wherein the information processing device is a cloud server.

[0060] (Item 12) An information processing device that communicates with another information processing device having a cloud browser function, a drawing means for drawing a user interface based on a font list of the information processing device; a transmitting means for transmitting the font list to the other information processing device; a receiving means for receiving a rendering result of the content generated by the other information processing device based on the font list; a display control means for displaying the user interface and the drawing result; An information processing device comprising:

[0061] (Item 13) A control method for an information processing device having a cloud browser function, comprising: a receiving step of receiving a first font list of the other information processing device from the other information processing device; a content acquisition step of acquiring content from a web server in response to a request from the other information processing device; a generating step of generating a rendering result based on the content and the first font list; a transmitting step of transmitting the drawing result to the other information processing device; 1. A method for controlling an information processing device, comprising:

[0062] (Item 14) A control method for an information processing device that communicates with another information processing device having a cloud browser function, comprising: a drawing step of drawing a user interface based on a font list of the information processing device; a transmitting step of transmitting the font list to the other information processing device; a receiving step of receiving a rendering result of the content generated by the other information processing device based on the font list; a display control step of displaying the user interface and the drawing result; 1. A method for controlling an information processing device, comprising:

[0063] (Item 15) 15. A program for causing a computer to execute the control method for an information processing device according to item 13 or 14.

[0064] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0065] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0066] 101: Cloud server, 102: ROM, 103: RAM, 104: External storage unit, 105: Input unit, 107: Network connection interface, 108: CPU, 301: Device, 302: ROM, 303: RAM, 304: External storage unit, 305: Input unit, 306: Display unit, 307: Network connection interface, 308: CPU, 309: Scanner unit, 310: Printer unit

Claims

1. An information processing device having a cloud browser function, a receiving means for receiving a first font list of the other information processing device from the other information processing device; a content acquisition means for acquiring content from a web server in response to a request from the other information processing device; a generating means for generating a rendering result based on the content and the first font list; a transmitting means for transmitting the drawing result to the other information processing device; An information processing device comprising:

2. an acquisition means for acquiring a second font list of the information processing device; a list generating means for generating a third font list based on the first font list and the second font list; 2. The information processing apparatus according to claim 1, wherein the generating means generates the rendering result based on the content and the third font list.

3. a first determining means for determining whether the first font list is an empty list; 3. The information processing apparatus according to claim 2, wherein the list generating means generates the third font list based on the first font list and the second font list when the first determining means determines that the first font list is not an empty list.

4. 4. The information processing device according to claim 3, wherein the generating means generates the drawing result based on the content and the second font list when the first determining means determines that the first font list is an empty list.

5. The method further includes a second determination means for determining whether the third font list exists; 3. The information processing device according to claim 2, wherein the generating means generates the drawing result based on the content and the third font list when the second determining means determines that the third font list exists.

6. 3. The information processing apparatus according to claim 2, wherein the list generating means generates the third font list so that fonts included in the first font list have a higher priority than fonts included in the second font list.

7. 3. The information processing apparatus according to claim 2, wherein the first font list and the second font list each include font names and font metadata.

8. 8. The information processing apparatus according to claim 7, wherein the metadata includes at least one of a language supported by the font, a version of the font, and a size of the font.

9. 2. The information processing apparatus according to claim 1, wherein, when the content specifies a font to be used, the generating means generates the drawing result based on the specified font.

10. a determining means for determining whether or not a font in the first font list exists in the information processing device based on the first font list; a request unit for requesting the font from the other information processing device when it is determined that the font in the first font list does not exist, 2. The information processing apparatus according to claim 1, wherein said receiving means further receives the font transmitted from said other information processing apparatus in response to a request made by said requesting means.

11. The information processing apparatus according to claim 1 , wherein the information processing apparatus is a cloud server.

12. An information processing device that communicates with another information processing device having a cloud browser function, a drawing means for drawing a user interface based on a font list of the information processing device; a transmitting means for transmitting the font list to the other information processing device; a receiving means for receiving a rendering result of the content generated by the other information processing device based on the font list; a display control means for displaying the user interface and the drawing result; An information processing device comprising:

13. A control method for an information processing device having a cloud browser function, comprising: a receiving step of receiving a first font list of the other information processing device from the other information processing device; a content acquisition step of acquiring content from a web server in response to a request from the other information processing device; a generating step of generating a rendering result based on the content and the first font list; a transmitting step of transmitting the drawing result to the other information processing device; 1. A method for controlling an information processing device, comprising:

14. A control method for an information processing device that communicates with another information processing device having a cloud browser function, comprising: a drawing step of drawing a user interface based on a font list of the information processing device; a transmitting step of transmitting the font list to the other information processing device; a receiving step of receiving a rendering result of the content generated by the other information processing device based on the font list; a display control step of displaying the user interface and the drawing result; 1. A method for controlling an information processing device, comprising:

15. 15. A program for causing a computer to execute the method for controlling an information processing device according to claim 13.

Images