Batch-optimized render and fetch architecture

A batch processing and processor technology, applied in the field of batch optimization rendering and acquisition architecture, can solve problems such as difficulties, and achieve the effect of avoiding timeout errors and common errors

Active Publication Date: 2017-02-22
GOOGLE LLC
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although it is relatively simple for a single user's web browser to render a single web page in real time, rendering a large number of pages in real time (such as all pages on the World Wide Web (1 trillion pages) or even just the top 1% of the World Wide Web pages (10 billion pages)) would be much harder

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Batch-optimized render and fetch architecture
  • Batch-optimized render and fetch architecture
  • Batch-optimized render and fetch architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to completely render a web page, the contents of all embedded external resources in the web page must first be obtained. These resources may include (but are not limited to) external images, JavaScript code, and style sheets. The same external resource is often embedded in many different web pages. While it is efficient for a single user's web browser to request external web page resources such as Google Analytics JavaScript code in real time (i.e., while rendering the page that embeds the resource), it is neither feasible for a batch rendering engine to do so It doesn't work either. For example for the web page indexing process, the batch rendering engine is designed to efficiently and quickly render large numbers of web pages at once. But fetching embedded external resources can be slow, and sometimes such resources are not critical to the batch process (e.g. no one user is viewing the final rendered product). To improve the processing time for rendering w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Implementations include a batch-optimized render and fetch architecture. An example method performed by the architecture includes receiving a request from a batch process to render a web page and initializing a virtual clock and a task list for rendering the web page. The virtual clock stands still when a request for an embedded item is outstanding and when a task is ready to run. The method may also include generating a rendering result for the web page when the virtual clock matches a run time for a stop task in the task list, and providing the rendering result to the batch process. Another example method includes receiving a request from a batch process to render a web page, identifying an embedded item in the web page, and determining, based on a rewrite rule, that the embedded item has content that is duplicative of content for a previously fetched embedded item.

Description

Background technique [0001] The World Wide Web is a rich source of information. Today, there are estimated to be over a trillion unique web pages. Many of these pages are dynamically created (eg, the home page of the New York Times) and have links to embedded content such as images and videos, which can affect the content and appearance of the rendered web page. For example, when a browser executes scripts such as JavaScript code, this can affect how a web page looks to a user and change the content and / or visual appearance of the page after the browser has finished rendering the web page. As another example, some web pages use style sheets, which tell the browser how to change the appearance of text. A typical web page may have hundreds of such additional embedded items, some of which are specifically designed for or targeted to the browser rendering engine. The additional information generated by the rendering process can be helpful to downstream systems such as internet ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F40/143
CPCG06F16/957G06F40/131G06F40/103G06F40/143G06F16/00G06F40/14G06F40/186G06F16/24578G06F16/9566
Inventor 方昊埃里克·阿尔扬·亨德里克斯许晖克里斯蒂安·塔普什鲁佩什·卡普尔
Owner GOOGLE LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap