Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A high-efficiency distributed big data data acquisition method and system

A technology of data collection and big data, which is applied in the field of high-efficiency distributed big data data collection and system field, which can solve the problems of low accuracy of target data and inability to efficiently collect massive data, and achieve the effect of high-efficiency distributed collection

Active Publication Date: 2021-12-31
北京黑马企服科技有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the deficiencies in the prior art, the purpose of the embodiment of the present application is to solve the problem in the prior art that mass data cannot be distributed and efficiently collected by providing a method and system for realizing efficient distributed big data collection. Technical problems that make the accuracy of the collected target data not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A high-efficiency distributed big data data acquisition method and system
  • A high-efficiency distributed big data data acquisition method and system
  • A high-efficiency distributed big data data acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] Such as figure 1 As shown, the embodiment of the present application provides a method for realizing efficient distributed big data collection, wherein the method includes:

[0024] Step S100: Obtain first video information;

[0025] Step S200: Perform feature extraction on the first video information to obtain text features, voice features and visual features of the first video information;

[0026] Specifically, with the rapid development of the Internet industry today, data collection has been widely used in the Internet and distributed fields, and important changes have taken place in the field of data collection. Data acquisition refers to the automatic collection of non-electrical or electrical signals from analog and digital units under test such as sensors and other equipment to be tested, and sends them to the host computer for analysis and processing. The data acquisition system is a flexible and user-defined measurement system combined with measurement soft...

Embodiment 2

[0065] Based on the same inventive concept as the method for realizing high-efficiency distributed big data collection in the foregoing embodiments, the present invention also provides a system for realizing high-efficiency distributed big data data collection, such as figure 2 As shown, the system includes:

[0066] The first obtaining unit 11: the first obtaining unit 11 is used to obtain the first video information;

[0067] The first extraction unit 12: the first extraction unit 12 is used to perform feature extraction on the first video information to obtain text features, phonetic features and visual features of the first video information;

[0068] The first analysis unit 13: the first analysis unit 13 is used to perform principal component analysis on the text features, the speech features and the visual features respectively, to obtain a first principal component feature set;

[0069]The second obtaining unit 14: the second obtaining unit 14 is used to obtain a firs...

Embodiment 3

[0091] Refer below image 3 An electronic device according to an embodiment of the present application will be described.

[0092] image 3 A schematic structural diagram of an electronic device according to an embodiment of the present application is shown.

[0093] Based on the inventive concept of an efficient distributed big data data acquisition implementation method in the aforementioned examples, the present invention also provides an efficient distributed big data data acquisition implementation system, on which a computer program is stored, and the program is executed by a processor When realizing the steps of any method of an efficient distributed big data data collection and realization system described above.

[0094] Among them, in image 3 In, bus architecture (represented by bus 300), bus 300 may include any number of interconnected buses and bridges, bus 300 will include one or more processors represented by processor 302 and various types of memory represen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a method and system for realizing high-efficiency distributed big data collection, wherein the method includes: obtaining first video information; performing feature extraction on the first video information, and obtaining the first video information Text features, phonetic features and visual features; principal component analysis is performed on the text features, the phonetic features and the visual features respectively to obtain the first principal component feature set; the first video set is obtained through big data, and the second A video collection includes video collections matching the first principal component feature set; performing principal component feature data collection on the first video collection according to the first principal component feature set. It solves the technical problem in the prior art that mass data cannot be distributed and efficiently collected, so that the accuracy of the collected target data is not high.

Description

technical field [0001] The present invention relates to the field of data collection, in particular to a method and system for realizing high-efficiency distributed big data data collection. Background technique [0002] Today, with the rapid development of the Internet industry, data collection has been widely used in the Internet and distributed fields, and important changes have taken place in the field of data collection. The data acquisition system is a flexible and user-defined measurement system combined with measurement software and hardware products based on computers or other special test platforms. [0003] However, in the process of realizing the technical solution of the invention in the embodiment of the present application, the inventor of the present application found that the above-mentioned technology has at least the following technical problems: [0004] In the prior art, there is a technical problem that mass data cannot be distributed and efficiently c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06F18/2135G06F18/214
Inventor 杨昕
Owner 北京黑马企服科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com