Supercharge Your Innovation With Domain-Expert AI Agents!

Streaming media log merging method

A streaming media and log technology, applied in digital data information retrieval, special data processing applications, instruments, etc., can solve the problems of occupying memory, unfavorable and fast calling log files, affecting system performance, etc., to reduce investment and improve data loading throughput. rate, speed up the effect of the merger

Pending Publication Date: 2022-04-05
E SURFING VIDEO MEDIA CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] A large number of audio and video resources generated in the era of information explosion, streaming media technology and related products will be more widely used in video-on-demand, live broadcast, distance education, etc. For the massive log files generated by streaming media playback, conventional log files are now stored directly in the server. Occupies a large amount of memory, and there are access tendency features in the log file, which will seriously affect the performance of the system after repeated calls, which is not conducive to the subsequent rapid call of the log file, so new requirements are put forward for the processing of the log file

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Streaming media log merging method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is carried out on the premise of the technical solution of the present invention, and detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

[0017] The streaming media log merging method of the present invention utilizes multiple gpfdist data sources to initialize and process the streaming media log into formatted data on the spot, utilizes the external table of the greenplum database and the gpfdist data source to load data at high speed in parallel, creates an entity table corresponding to the external table, and actually loads The external table data is sent to the entity table, and finally the logs of the same business identifier are merged and stored through the SQL aggregation statement supported by the standard green...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a streaming media log merging method, which comprises the following steps of: locally initializing a streaming media log into formatted data by multiple gpfdist data sources, loading data at a high speed in parallel by utilizing an external table of a greenplum database and the gpfdist data sources, classifying and merging different log records, and reconstructing data configuration. A distributed database, a large-scale parallel processing architecture and an SQL (Structured Query Language) are utilized to realize a method for aggregating similar data such as streaming media playing logs. Streaming media log merging is accelerated, and resource and manpower input is reduced. According to the method, high-speed parallel loading can be carried out on the multiple data source servers and the distributed database, the data loading throughput rate is increased, all service identification data are dispersed through the related technology of the distributed database, and practicability is achieved in the aspect of aggregation of similar data. The method is suitable for CDN log aggregation and user behavior log shrinkage.

Description

technical field [0001] The invention relates to a data storage technology, in particular to a streaming media log merging method. Background technique [0002] A large number of audio and video resources generated in the era of information explosion, streaming media technology and related products will be more widely used in video-on-demand, live broadcast, distance education, etc. For the massive log files generated by streaming media playback, conventional log files are now stored directly in the server. Occupies a large amount of memory, and there are access tendency features in the log file, which will seriously affect the performance of the system after repeated calls, which is not conducive to the subsequent rapid call of the log file, so new requirements are put forward for the processing of the log file. Contents of the invention [0003] Aiming at the problem of storing massive log files, a streaming media log merging method is proposed, which uses distributed dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/18G06F16/182
Inventor 李滚李灏庄之骏邱国伟
Owner E SURFING VIDEO MEDIA CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com