Unlock instant, AI-driven research and patent intelligence for your innovation.

A live webpage crawling method and device

A web page and web page address technology, applied in the Internet field, can solve the problem of inability to crawl live broadcast data, and achieve the effect of ensuring comprehensiveness

Active Publication Date: 2021-04-27
BEIJING GRIDSUM TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Since the live broadcast data on the live broadcast webpage, such as barrage content and number of visitors, will be updated in real time and will not be saved, traditional static web crawlers cannot crawl all the live broadcast data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A live webpage crawling method and device
  • A live webpage crawling method and device
  • A live webpage crawling method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045]An exemplary embodiment of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be implemented in various forms and should not be restricted herein. Instead, it is provided to provide more thoroughly understood the present disclosure, and can communicate the scope of the disclosure to those skilled in the art.

[0046]The embodiment of the present invention provides a live webpage crawling method, and the method of the method is shown.figure 1 As shown, including the following steps:

[0047]S10, receive live web clipping instructions, the live web clip instruction includes live broadcast period, target live web address;

[0048]During the process of performing step S10, due to the live broadcast of video live, it also has timing, that is, the live broadcast period of video live is predicted, for e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a live webpage crawling method and device. The method includes: receiving a live webpage crawling instruction, the live webpage crawling instruction including a live broadcast period and a target live webpage address; The target live webpage corresponding to the address is loaded into the tab page of the default browser; if the target live webpage is loaded in the tab page, the predefined crawling script file is embedded into the tab page; real-time detection of whether the target live webpage meets the Preset crawling conditions, and when the preset crawling conditions are met, run the crawling script file to crawl live data on the target live webpage. This makes it possible to continuously crawl live data while the live web page is running, thereby ensuring the comprehensiveness of the crawled live data.

Description

Technical field[0001]The present invention relates to the field of Internet technologies, and more particularly to a live web clipping method and apparatus.Background technique[0002]Video live refers to the user's live video live video live video, such as an aquatic performance, event, conference, etc.[0003]Due to live broadcast data on live web, for example, the number of barrage content and visitors will be updated in real time, and will not be saved, so traditional static web climbing cannot climb all live data.Inventive content[0004]In view of the above problems, the present invention is proposed to provide a live web clip method and apparatus overcoming the above problems or at least partially solving the above problems.[0005]The specific technical solutions are as follows:[0006]A live web clip method, including:[0007]Receive live web clip instructions, the live web clipping instruction includes live broadcast period, target live web address;[0008]During the live broadcast peri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/953
CPCG06F16/951
Inventor 满悦
Owner BEIJING GRIDSUM TECH CO LTD