A mobile application data collection method and device

A technology of data collection and mobile application, applied in the network field, can solve the problems of incomplete data collection by Sogou WeChat, large influence of proxy server network, unstable collection, etc., and achieve the effect of complete automation of the driving process.

Active Publication Date: 2021-12-31
NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] 1) The data collected by Sogou WeChat is incomplete
[0009] 2) The proxy server is greatly affected by the network, and the collection is unstable
[0010] 3) Collection requires manual participation, and the collection cost is high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A mobile application data collection method and device
  • A mobile application data collection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Embodiment 1 (when the application is a WeChat official account)

[0041] S21. Record the script of the user's operation process on the WeChat official account.

[0042] According to the operation process of the user opening WeChat, searching the official account, adding the official account, entering the official account, and browsing the official account articles, combined with the UIAutomator Viewer control information viewing tool, view the interface controls of each step in the process, and record the text information of the control and the corresponding control Coordinate information, generate script. The script records the operation flow of the user on the WeChat official account, and records the text information of the control and the corresponding coordinate information of the control in the operation flow of each step.

[0043] In each step of the script, if the text information of the control and the corresponding coordinate information of the control are re...

Embodiment 2

[0057] Embodiment 2 (when the application is a news application such as Jinri Toutiao and Xiaohongshu), the following uses Jinri Toutiao as an example for illustration.

[0058] S31. Record the script of the user's browsing operation process of today's headlines.

[0059] According to the user's operation process of opening Toutiao, subscribing to a channel, entering a channel, browsing news, and switching to the next news, combined with the UIAutomator Viewer control information viewing tool, view the interface control of each step in the process, record the text information of the control and the corresponding coordinate information of the control , to generate the script. The script records the operation flow of the user browsing the news, and records the text information of the control and the corresponding coordinate information of the control in each step of the operation flow.

[0060] In each step of the script, if the text information of the control and the correspon...

Embodiment 3

[0070] Based on the same inventive concept, the present invention discloses a mobile application data acquisition device, the structural diagram is as follows figure 2 As shown, the device includes:

[0071] The recording module 201 is used to record the script of the user's operation process of the application;

[0072] The driver module 202 is configured to load the script, and instruct the application client to send a request to the application server according to the keywords in the pre-stored search keyword list, to obtain historical messages sent by the application server, so that the proxy server intercepts the Write the historical messages sent by the application server to the database;

[0073] The parsing module 203 parses the historical messages written in the database, and extracts the article data of the application.

[0074] Preferably, the device further includes: a monitoring module 204, which monitors the process of the application to be collected by pollin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for collecting mobile application data. The method includes: recording a script of the user's operation process of the application; loading the script, and instructing the application client according to the keywords in the pre-stored search keyword list Send a request to the application server to obtain the historical messages sent by the application server, so that the proxy server intercepts the historical messages sent by the application server and writes them into the database; parses the historical messages written into the database, and extracts the article data of the application . By adopting the invention, mobile application data can be fully and automatically collected.

Description

technical field [0001] The invention relates to the field of network technology, in particular to a method and device for collecting mobile application data. Background technique [0002] At present, there are mainly two technical solutions for collecting the content of WeChat public accounts, one is a web crawler, and the other is based on a proxy server. [0003] Web Crawler [0004] At present, most of the collection of WeChat public accounts is based on the Sogou portal, such as the simple number data collection platform and the Octopus platform. This method is simple to implement. However, in the face of the anti-crawler mechanism of Sogou WeChat, verification codes will appear when the collection is too frequent. Take the docking coding platform or switch the proxy server to solve the low collection efficiency. When the verification code cannot be recognized, the collection is interrupted. On the other hand, the collection of official account articles based on Sogou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/951
CPCG06F16/951
Inventor 高川韩志辉何能强严寒冰丁丽常霞狄少嘉徐原温森浩李志辉姚力朱芸茜郭晶朱天胡俊王小群吕利锋张腾王庆陈阳李世淙徐剑王适文饶毓肖崇蕙贾子骁张帅吕志泉马莉雅张宇鹏雷君周彧周昊贾世琳吕卓航楼书逸文静
Owner NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap