Unlock instant, AI-driven research and patent intelligence for your innovation.

Film and television big data acquisition method and system

A collection method and data collection technology, applied in the field of information, can solve the problems of fast and efficient capture of web page data, inability to perform image recognition, inability to obtain images of qualified quality, etc., and achieve fast and efficient capture and simple data collection methods. Effect

Inactive Publication Date: 2017-02-15
杭州探索文化传媒有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The existing web crawler technology, due to the limitations of the crawler program on major websites, makes the crawler unable to quickly and efficiently grab massive web data; and the existing image recognition technology can only be used when the picture quality is relatively good and there is no distortion. However, due to many reasons such as light and location, many pictures cannot obtain qualified images, resulting in the inability to perform image recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Film and television big data acquisition method and system
  • Film and television big data acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0020] A method for collecting big data of film and television, by setting a TV data collection module on a TV terminal and an Internet data collection module on an Internet terminal, and collecting the film and television data of the TV terminal and the Internet terminal to a data collection server.

[0021] The data collected by the TV data collection module is TV film and television data such as TV screenshots and station logo information.

[0022] The data collected by the Internet data collection module is Internet video data such as user viewing behavior, video information, news and entertainment related to film and television.

[0023] The method of collecting data by the TV data collection module is as follows: the TV data collection module invokes the program interface provided by the TV terminal, takes a screenshot of the user's TV screen when the user starts the machine and is in the live viewing state, analyzes the color and coordinate value of the image obtained by...

Embodiment 2

[0030] A film and television big data collection system, including a data collection server and a TV data collection module; the data collection server communicates with the TV data collection module through a TV network, such as figure 1 shown.

Embodiment 3

[0032] A film and television big data acquisition system, including a data acquisition server and an Internet data acquisition module; the data acquisition server communicates with the Internet data acquisition module through the Internet, such as figure 2 shown.

[0033] A film and television big data collection method, by setting a master node and a slave node for communication using the ssh protocol, the master node controls the slave node to perform data collection, and the master node communicates with a data collection server. When deploying the film and television big data collection system, enable the IP proxy and add random UA. There are 5 crawler servers, one of which is the master node and 4 are slave nodes. The URL of the above website is saved on the crawler server. When the crawling task starts , these fetched URLs and fetching tasks will be sent to 4 slave nodes, and the load of each slave will be dynamically adjusted when dispatching. For example, one of the s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a film and television big data acquisition method. A television data acquisition module is disposed at a television terminal, an internet data acquisition module is disposed at an internet terminal, so that film and television data of the television terminal and the internet terminal is collected and put in a data acquisition server. The present invention further discloses a film and television big data acquisition system. The system comprises the data acquisition server, the internet data acquisition module, and the television data acquisition module. The data acquisition server communicates with the internet data acquisition module by using the internet, and the data acquisition server communicates with the television data acquisition module by using a television internet. Compared with the prior art, the film and television big data acquisition method and system have the advantages that the television data acquisition module can acquire television and film data efficiently according to television terminals of different models, the data acquisition manner is simple, rapid and accurate; and the internet data acquisition module can break through the limitation of the existing website so as to collect data among massive webpage data rapidly and efficiently.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a method and system for collecting big data of film and television. Background technique [0002] With the development of cloud computing and big data, the older and more users choose to watch film and television works on a variety of terminals, so more and more film and television companies need to analyze various situations of users through film and television big data information to develop and produce New film and television content to meet the needs of the market. [0003] Existing film and television big data collection generally adopts web crawler technology and image recognition technology. Web crawler technology is a program that automatically and intelligently obtains webpage information on the Internet according to certain rules. Web crawler technology can be used to collect information on film and television related websites; image recognition technology refers ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/232H04N21/24H04N21/25H04N21/44H04N21/443H04N21/61
CPCH04N21/44008H04N21/232H04N21/2405H04N21/251H04N21/4431H04N21/6125H04N21/6175
Inventor 董大伟
Owner 杭州探索文化传媒有限公司