Data collection method and related device

Abstract

The present application provides a data collection method and related devices, which are applied to electronic devices, and the method includes: obtaining first data; determining characteristic information of each first data item, wherein the characteristic information is determined according to the first data type information and / or size information; and storing each first data item in a corresponding storage area according to the characteristic information. In the process of data collection, data can be obtained and classified and stored according to the characteristic information of the data, so that the subsequent process of searching for related data is faster and more accurate, which meets the demand of the energy industry for data collection to the greatest extent.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a data collection method and related devices. Background Art

[0002] In the era of digital economy, big data platforms make full use of big data resources to support innovation and development. Big data has not only become a new type of key production factor, but also a powerful engine for promoting economic and social development. The advantages of big data platforms include: content sharing, resource sharing, channel co-construction, and technology sharing.

[0003] Since the amount of data in the energy industry is huge and complex, the process of data aggregation also requires the support of a big data platform. The data aggregation process of the big data platform is the process of data collection. Different big data platforms can collect different types of data. In the process of simultaneously aggregating data on multiple big data platforms, the data source information of the big data platform is too large, and the collected information cannot be reasonably stored and classified, making it inconvenient to search and view the data information, and cannot meet the energy industry's needs for data aggregation and processing. Summary of the invention

[0004] The technical problem to be solved by the embodiments of the present invention is to provide a data collection method and related devices, which realize the classified storage and fast search of data information.

[0005] In a first aspect, an embodiment of the present invention provides a data collection method, the method comprising:

[0006] Acquire first data;

[0007] Determine characteristic information of each item of first data, wherein the characteristic information is determined according to the first data type information and / or size information;

[0008] Each item of the first data is stored in a corresponding storage area according to the characteristic information.

[0009] It can be seen that in the embodiment of the present application, the system obtains the first data, and then determines the characteristic information of each item of the first data, wherein the characteristic information is determined according to the first data type information and / or size information, and finally each item of the first data is stored in the corresponding storage area according to the characteristic information. By classifying and storing the collected data, data integration and induction are achieved, so that the process of data collection is more efficient and convenient for subsequent data search.

[0010] In a second aspect, an embodiment of the present invention provides a data collection device, which is applied to an electronic device, and the device includes:

[0011] A receiving module, used for acquiring the first data;

[0012] an analysis module, configured to determine characteristic information of each item of first data, wherein the characteristic information is determined according to the first data type information and / or size information;

[0013] A processing module, configured to store each item of the first data into a corresponding storage area according to the characteristic information;

[0014] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps of any method in the first aspect of the embodiment of the present application.

[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps described in any method of the first aspect of the embodiment of the present application.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in any method of the first aspect of the embodiment of the present application. The computer program product may be a software installation package.

[0017] By implementing the embodiments of the present invention, it is achieved that in the process of data collection, data can be acquired and classified and stored according to feature information of the data, so that the subsequent process of searching for related data is more convenient and quick. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0019] Figure 1 It is a system architecture diagram of a data collection method provided in an embodiment of the present application;

[0020] Figure 2 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application

[0021] Figure 3 It is a flow chart of a data collection method provided in an embodiment of the present application;

[0022] Figure 4 It is a flowchart of another data collection method provided in an embodiment of the present application;

[0023] Figure 5 This is a block diagram of the functional modules of a data collection device provided in an embodiment of the present application;

[0024] Figure 6 It is a block diagram of the functional units of another data collection device provided in an embodiment of the present application; DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0027] It should be understood that the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article indicates that the associated objects before and after are in an "or" relationship. The "plurality" appearing in the embodiments of the present application refers to two or more.

[0028] In the embodiments of the present application, "at least one item" or similar expressions refer to any combination of these items, including any combination of single items or plural items, and refer to one or more, and multiple refers to two or more. For example, at least one item of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.

[0029] The "connection" that appears in the embodiments of the present application refers to various connection methods such as direct connection or indirect connection to achieve communication between devices, and the embodiments of the present application do not impose any limitations on this.

[0030] Mentioning "embodiment" in this article means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments. However, due to the dispersion of business systems and the inconsistency of collection and processing tools, data collection and data processing tasks are still decentralized processing and decentralized operation. It is not conducive to the unified orchestration and management of tasks, and it is impossible to reuse resources, which increases the workload.

[0031] The following is an explanation of the relevant contents, concepts, meanings, technical issues, technical solutions, beneficial effects, etc. involved in the embodiments of the present application.

[0032] In the era of digital economy, big data platforms make full use of big data resources to support innovation and development. Big data has not only become a new type of key production factor, but also a powerful engine for promoting economic and social development. Due to the huge and complex data volume in the energy industry, the support of big data platforms is also needed in the process of data collection. The data collection process of the big data platform is the process of data collection. Different big data platforms can collect different types of data. In the process of simultaneously collecting data on multiple big data platforms, the data source information of the big data platform is too large, and the collected information cannot be reasonably stored and classified, resulting in a more difficult process for finding data information. It also takes a long time to find data information, which affects work efficiency and cannot meet the energy industry's needs for data processing.

[0033] To solve the above problems, an embodiment of the present application provides a data collection method, which can obtain first data and then determine characteristic information of each first data item, wherein the characteristic information is determined according to the first data type information and / or size information, and finally store each first data item in a corresponding storage area according to the characteristic information. By classifying and storing the collected data, data integration and induction are achieved, so that the data collection process is more efficient, which facilitates subsequent data search, thereby improving work efficiency and speeding up the work progress.

[0034] Combine the following Figure 1 The system architecture of a data collection method in an embodiment of the present application is described. Figure 11 is a system architecture diagram of a data collection method provided in an embodiment of the present application. The data collection system includes five modules: a receiving module 110 , a recording module 111 , an analyzing module 112 , a processing module 113 , and a storage module 114 .

[0035] The receiving module 110 is used to receive data information uploaded to the system.

[0036] In a possible embodiment, the receiving module 110 establishes connections with various data sources, the data sources upload data information to the receiving module 110, and the receiving module 110 receives data information from various data sources.

[0037] In a possible embodiment, the receiving module 110 can establish a communication connection with the data source according to the data transmission instruction of the receiving module 110 or the data transmission instruction of the data source, and then obtain a list of all transmittable data from the data source, output and display the list of all transmittable data, obtain a target data list from the list of all transmittable data, and send the target data list to the data source, so that the data source sends the data corresponding to the target data list to the receiving module 110, and the receiving module 110 receives the data corresponding to the target data list sent by the data source.

[0038] The recording module 111 is used to record information of received data.

[0039] In one possible embodiment, when the receiving module 110 receives data information, the recording module 111 identifies the received data, obtains the associated information of the data to be recorded, the associated information includes type information, size information, source information and sending and receiving time information, and records the associated information, creates an associated information record list, the associated information record list is used to record the associated information of the data, and adds the record of the associated information to the associated information record list to facilitate subsequent query and processing of the relevant information of the data.

[0040] The analysis module 112 is used to analyze and identify valid feature information of the received data.

[0041] In a possible embodiment, the analysis module 112 may perform feature extraction on the received data and determine whether the extracted feature information is recognizable. If recognizable, valid feature information therein is obtained, and the valid feature information includes data type information and size information. If it is not recognizable, the current data is discarded. It should be noted that when performing feature extraction on the received data, the associated information of the data can be quickly obtained according to the associated information record list in the recording module 111. Through the record of data associated information, the valid feature information of the data, namely the type information and size information, can be determined, and it can be determined whether the valid feature information is recognizable. Finally, the recognizable valid feature information is obtained, which is convenient for subsequent classification and storage of the data.

[0042] The processing module 113 is used for classifying and storing data according to feature information of the data.

[0043] In a possible embodiment, the processing module 113 determines the characteristic information of the data based on the type information and / or size information of the data, that is, determines the characteristic information based on at least one item of the valid characteristic information of the data, and then classifies the data according to the different characteristic information to obtain the data set corresponding to each characteristic information. The processing module 113 sets the storage area corresponding to each type information and / or size information in advance, and then stores the data set corresponding to each type information and / or each size information in the corresponding storage area according to a preset mapping relationship.

[0044] The storage module 114 is used to store each data set separately.

[0045] In one possible embodiment, the storage module 114 sets the storage disk into several separate storage areas. According to the mapping relationship set by the processing module 113, each storage area corresponds to each data set. After obtaining the classified data from the processing module 113, the data is stored in storage areas at different locations according to the classification categories. Since the storage areas are divided into categories and separate spaces, different data do not interfere with each other. The subsequent query process of the data can be faster and more convenient, and data search errors are less likely to occur.

[0046] It can be seen that by using the above system architecture, it is possible to obtain data and classify and store it according to the characteristic information of the data during the data collection process, so that the subsequent process of searching for related data is faster and more accurate.

[0047] Combine the following Figure 2 The electronic device in the embodiment of the present application is described. Figure 2 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 2As shown, the electronic device includes one or more application processors 220, a memory 230, a communication module 240 and one or more programs 231. The application processor 220 is communicatively connected with the memory 230 and the communication module 240 via an internal communication bus.

[0048] The one or more programs 231 are stored in the memory 230 and configured to be executed by the application processor 220 . The one or more programs 231 include instructions for executing any step in the method embodiment.

[0049] Among them, the application processor 220 can be, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, units and circuits described in conjunction with the disclosure of this application. The application processor 220 can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of DSP and microprocessors, and the like. The communication unit can be a communication module 240, a transceiver, a transceiver circuit, etc., and the storage unit can be a memory 230.

[0050] The memory 230 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0051] It is understood that the electronic device 20 may include more or fewer structural elements than those in the above structural block diagram, for example, including a power module, physical buttons, a Wi-Fi module, a speaker, a Bluetooth module, a sensor, a display module, etc., which are not limited here. It is understood that the electronic device 20 may be equipped with Figure 1 The system architecture described.

[0052] After understanding the software and hardware architecture of this application, Figure 3 A data collection method in an embodiment of the present application is described. Figure 3 A flow chart of a data collection method provided in an embodiment of the present application specifically includes the following steps:

[0053] Step S301: Acquire first data.

[0054] Wherein, a data source may be established first, and then each item of first data from each data source may be received.

[0055] Specifically, the system first establishes a communication connection with a data source, which includes a user device and a platform. Each data source starts uploading first data to the system, and then the system receives the first data uploaded by each data source to obtain each item of first data.

[0056] In one possible embodiment, when a communication connection is established between the system and the data source, the connection can be established through a wireless network, wherein the system and the data source are first connected to the same wireless network, and then the data source randomly generates a dynamic connection code before uploading data, and sends the dynamic connection code to the system. The system inputs the dynamic connection code into the communication connection interface in response to an input instruction. When the system determines that the received dynamic connection code is consistent with the input dynamic connection code, a communication connection between the system and the data source can be established.

[0057] In a possible embodiment, when a data source uploads first data to the system, the data source displays a list of all transmittable data after determining the list of all transmittable data, and the system obtains a list of target data to be uploaded, and sends the list of target data to the data source so that the data source uploads the first data corresponding to the list of target data. The system then receives the first data uploaded by the data source, and at the same time, the steps for each data source to upload its first data are consistent with the above steps, so that the system can obtain each item of first data from each data source.

[0058] Step S302: Determine characteristic information of each item of first data.

[0059] Among them, the characteristic information is determined according to the first data type information and / or size information, and the valid characteristic information of each first data can be recorded, the valid characteristic information includes the type information and size information of each first data, and then the characteristic information is determined according to at least one item of the valid characteristic information.

[0060] Specifically, the associated information of each first data, namely, type information, size information, source information and sending and receiving information, can be recorded, a list of associated information records can be created, and the records of associated information can be added to the list of associated information records. Then, the associated information of the data can be quickly obtained according to the list of associated information records. Through the records of the associated information of the data, the type information and size information of the data can be determined, and it can be judged whether the valid characteristic information can be identified, and the identifiable valid characteristic information can be obtained. Finally, the characteristic information of the data can be determined according to the type information and / or size information of the data, that is, the characteristic information of the data can be determined according to at least one item of the valid characteristic information of the data.

[0061] Step S303: storing each item of the first data into a corresponding storage area according to the characteristic information.

[0062] Among them, each item of first data can be classified according to the type information of each item of first data and / or the size information of each item of first data to obtain a data set corresponding to each type of information and / or each size information, and then the data set corresponding to each type of information and / or each size information can be stored in a corresponding storage area according to a preset mapping relationship, and the preset mapping relationship is used to reflect the storage area corresponding to each type of information and / or each size information, wherein each storage area is any one of a preset number of separate storage spaces divided by a storage disk.

[0063] Specifically, the storage disk can be first set up as several separate storage areas, and the storage area corresponding to each type of information and / or size information can be pre-set. Then, according to the determined characteristic information of each first data, each first data can be classified to obtain a data set corresponding to each characteristic information. According to the preset mapping relationship of each first data, the data set corresponding to each type of information and / or each size information can be stored in the corresponding storage area.

[0064] In a possible embodiment, if the characteristic information of the data is determined by its type information, where the type information includes multiple data types, namely type A, type B, type C, etc., all data whose data type is type A are summarized into a data set of category A1 corresponding to type A, all data whose data type is type B are summarized into a data set of category B1 corresponding to type B, all data whose data type is type C are summarized into a data set of category C1 corresponding to type C, and so on, all data are classified and summarized to obtain a data set corresponding to each type of information.

[0065] In a possible embodiment, if the characteristic information of the data is determined by its size information, the data can be classified and summarized by dividing the range such as within 10KB, within 10MB, within 10GB, etc., and the size range of the data is not limited here. All data with a size within 10KB is summarized into a data set of category A2 corresponding to the data size within 10KB, all data with a size within 10MB is summarized into a data set of category B2 corresponding to the data size within 10MB, all data with a size within 10GB is summarized into a data set of category C2 corresponding to the data size within 10GB, and so on. All data are classified and summarized to obtain a data set corresponding to each size information.

[0066] In a possible embodiment, if the characteristic information of the data is determined by its type information and size information, the data can make different combinations of different types and sizes of data to obtain data sets of different data categories determined by the type and size, and all data can be classified and summarized according to different data categories, and all data that meet the category can be summarized into the data set corresponding to the category.

[0067] In a possible embodiment, the data set corresponding to each type of characteristic information is determined by the characteristic information, and the different data sets are stored in corresponding storage areas according to the preset mapping relationship of each first data, wherein the preset mapping relationship makes the storage areas at different locations correspond to the categories of the above-mentioned data sets.

[0068] It can be seen that through the above method, data can be transmitted to the system, and the set analysis module and processing module can be used to analyze and process the collected data, so as to store data of different types and sizes in a separate storage area, and effectively integrate and summarize the collected data information, which provides convenience for subsequent reference to the data information. When the system's receiving module receives data information, the recording module can record it, that is, the type information, size information, source information and sending and receiving information of the data are recorded in detail, which is convenient for users to query the data.

[0069] Combine the following Figure 4 Another data collection method in the embodiment of the present application is described. Figure 4 A flow chart of another data collection method provided in an embodiment of the present application specifically includes the following steps:

[0070] Step S401: Acquire first data.

[0071] Wherein, a data source may be established first, and then each item of first data from each data source may be received.

[0072] Step S402: Determine characteristic information of each item of first data.

[0073] Among them, the characteristic information is determined according to the first data type information and / or size information, and the valid characteristic information of each first data can be recorded, the valid characteristic information includes the type information and size information of each first data, and then the characteristic information is determined according to at least one item of the valid characteristic information.

[0074] Step S403: storing each item of the first data into a corresponding storage area according to the characteristic information.

[0075] Among them, each first data can be classified according to the type information of each first data and / or the size information of each first data to obtain a data set corresponding to each type information and / or each size information, and then the data set corresponding to each type information and / or each size information can be stored in a corresponding storage area according to a preset mapping relationship, and the preset mapping relationship is used to reflect the storage area corresponding to each type information and / or each size information, wherein each storage area is any one of a preset number of separate storage spaces divided by a storage disk.

[0076] In a possible embodiment, the data is classified according to its characteristic information to obtain a data set corresponding to each characteristic information, and then the data set corresponding to each characteristic information is stored in a corresponding storage area according to a preset mapping relationship, and the preset mapping relationship is used to reflect the storage area corresponding to the characteristic information.

[0077] Step S404: Determine the source information and the sending and receiving time information of each item of the first data.

[0078] Among them, the source information and the sending and receiving time information of each item of the first data can be determined.

[0079] Specifically, each first data associated information record can be obtained from the associated information record list, and its source information and sending and receiving time information can be determined according to the associated information record of each first data, and it can be judged whether the source information and sending and receiving information can be identified, and the identifiable source information and sending and receiving time information can be obtained. Finally, the tag information of the data can be determined according to the source information and / or sending and receiving time information of each first data, so as to facilitate the subsequent tracing of related data according to the tag information.

[0080] In one possible embodiment, the associated information record of the data is obtained from the associated information record list, the source information and the sending and receiving time information of the data are determined according to the associated information record of the data, and it is judged whether the source information and the sending and receiving information are identifiable. If they are identifiable, the identifiable source information and the sending and receiving time information are obtained; if they are not identifiable, the data is discarded.

[0081] Step S405: In response to the keyword search instruction, call the first data matching the keyword from the storage area.

[0082] In response to a keyword search instruction, first data matching the keyword may be retrieved from the storage area.

[0083] Specifically, it can respond to a keyword search instruction and determine by the motor to retrieve data information, retrieve the data in the storage area according to the keyword, match the keyword with the data information in the storage area to obtain the first data matching the keyword, and then retrieve the first data matching the keyword from the storage area to check the data information, making the process of querying data information more convenient and quick.

[0084] In one possible embodiment, the storage area is divided into several different categories of storage areas based on feature information. The storage areas of different categories exist separately. During the retrieval process, only the storage areas with categories related to the search terms need to be searched, and then the keywords are matched with the data information in the storage areas to obtain the first data matching the keywords, thereby reducing the time cost of retrieving data and facilitating accurate and fast search for data.

[0085] Step S406: Display the first data and interactive controls matching the keyword.

[0086] Among them, in response to an interactive instruction for the interactive control, it is possible to jump to a data source corresponding to the source information of the first data matching the keyword, and the interactive control is used to display the source information and sending and receiving time information of the first data matching the keyword.

[0087] Specifically, after the retrieval is completed, the first data matching the keyword can be displayed to obtain the data information required by the user. At the same time, an interactive control can be displayed in the interactive interface of the system, and the interactive control is used to display the source information and sending and receiving time information of the first data matching the keyword. Then, by responding to the interactive instruction for the interactive control, it jumps to the data source corresponding to the source information of the first data matching the keyword, and displays the source information and sending and receiving time information of the first data matching the keyword, so as to facilitate the user to trace the data.

[0088] In a possible embodiment, according to data tracing requirements, data matching specified keywords are retrieved, and after the retrieval is completed, the data and interactive controls matching the keywords are displayed, and then in response to interactive instructions for the interactive controls, the data source corresponding to the source information of the first data matching the keyword is jumped to obtain the source information and sending and receiving time information of the first data matching the keyword, and the data is traced according to its source information and sending and receiving time information.

[0089] It can be seen that through the above method, data can be transmitted to the system, and the set analysis module and processing module can be used to analyze and process the collected data, so as to store data of different types and sizes in a separate storage area, and effectively integrate and summarize the collected data information, which provides convenience for subsequent reference to the data information. When the system's receiving module receives data information, the recording module can record it, that is, the type information, size information, source information and sending and receiving information of the data are recorded in detail, which is convenient for users to query and trace the data. Users can quickly query and obtain the required data information by searching keywords, which is convenient to improve work efficiency.

[0090] The steps not described in detail above can be found in Figure 3 The description of the steps of the method will not be repeated here.

[0091] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the execution process on the method side. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0092] The embodiment of the present application can divide the electronic device into functional units according to the above method example. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0093] In the case of dividing each functional module into corresponding functional modules, Figure 5 This is a functional module composition block diagram of a data collection device provided in an embodiment of the present application. The data collection device 500 includes:

[0094] A receiving module 510, configured to obtain the first data;

[0095] An analysis module 520, configured to determine feature information of each item of first data, wherein the feature information is determined according to the first data type information and / or size information;

[0096] The processing module 530 is used to store each item of the first data into a corresponding storage area according to the characteristic information.

[0097] It can be seen that the data collection method and related devices can obtain data and classify and store data according to its characteristic information during the data collection process, so as to make the subsequent process of searching for related data more convenient and quick.

[0098] It should be noted that the specific implementation of each operation can adopt the corresponding description of the method embodiment shown above, and the data collection device 500 can be used to execute the above method embodiment of the present application, which will not be described in detail.

[0099] In the case of an integrated unit, the following combination Figure 6 Another data collection device 600 in an embodiment of the present application is described in detail, and the data collection device 600 includes a processing unit 601 and a communication unit 602, wherein the processing unit 601 is used to execute any step in the above method embodiment, and when performing data transmission such as sending, the communication unit 602 can be selectively called to complete the corresponding operation.

[0100] The data collection device 600 may further include a storage unit 603 for storing program codes and data. The processing unit 601 may be a processor, the communication unit 602 may be a wireless transceiver, the storage unit 603 may be a memory, and the processing unit 601 is specifically used for:

[0101] Acquire first data;

[0102] Determine characteristic information of each item of first data, wherein the characteristic information is determined according to the first data type information and / or size information;

[0103] Each item of the first data is stored in a corresponding storage area according to the characteristic information.

[0104] It can be seen that the data collection method and related devices can obtain data and classify and store data according to its characteristic information during the data collection process, so as to make the subsequent process of searching for related data more convenient and quick.

[0105] It should be noted that the specific implementation of each operation can adopt the corresponding description of the method embodiment shown above, and the data collection device 600 can be used to execute the above method embodiment of the present application, which will not be described in detail.

[0106] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps of any method recorded in the above method embodiment, and the above computer includes an electronic device.

[0107] The embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, the computer program is operable to cause a computer to execute some or all of the steps of any method described in the method embodiment. The computer program product may be a software installation package, and the computer includes an electronic device.

[0108] It should be noted that, for the above-mentioned various embodiments, for the sake of simple description, they are all expressed as a series of action combinations. Those skilled in the art should be aware that the present application is not limited by the described order of actions, because some steps in the embodiments of the present application can be performed in other orders or simultaneously. In addition, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions, steps, modules or units involved are not necessarily required by the embodiments of the present application.

[0109] In the above embodiments, the embodiments of the present application have different focuses on the description of each embodiment. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0110] In summary, by implementing the embodiments of the present invention, data can be transmitted to the system, and the collected data can be analyzed and processed by using the set analysis module and processing module, so that data of different types and sizes can be stored in a separate storage area, and the collected data information can be effectively integrated and summarized, which provides convenience for subsequent reference to the data information. When the system's receiving module receives data information, the recording module can record it, that is, the type information, size information, source information and sending and receiving information of the data are recorded in detail, which is convenient for subsequent users to query and trace the data. Users can quickly query and obtain the required data information by searching keywords, which is convenient for improving work efficiency.

[0111] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0112] The steps of the method or algorithm described in the embodiments of the present application can be implemented in hardware or by executing software instructions by a processor. The software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM, flash memory, ROM, EPROM, electrically erasable programmable read-only memory (electrically EPROM, EEPROM), registers, hard disks, mobile hard disks, read-only compact disks (CD-ROMs) or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a terminal device or a management device. Of course, the processor and the storage medium can also be present in a terminal device or a management device as discrete components.

[0113] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiments of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server, or data center to another website site, computer, server, or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0114] The modules / units included in the devices and products described in the above embodiments may be software modules / units or hardware modules / units, or may be partially software modules / units and partially hardware modules / units. For example, for the devices and products applied to or integrated in the chip, the modules / units included therein may all be implemented in the form of hardware such as circuits, or at least some of the modules / units may be implemented in the form of software programs, which run on the processor integrated inside the chip, and the remaining (if any) modules / units may be implemented in the form of hardware such as circuits; for the devices and products applied to or integrated in the chip module, the modules / units included therein may all be implemented in the form of hardware such as circuits, and different modules / units may be located in the same component (such as a chip, circuit module, etc.) or in different components of the chip module, or at least some of the modules / units may be implemented in the form of software programs. The software programs run on the processor integrated inside the chip, and the remaining (if any) modules / units may be implemented in the form of hardware such as circuits. It is implemented in the form of a software program, which runs on a processor integrated inside the chip module, and the remaining (if any) modules / units can be implemented in hardware such as circuits; for various devices and products applied to or integrated in the terminal equipment, the various modules / units contained therein can be implemented in hardware such as circuits, and different modules / units can be located in the same component (for example, chip, circuit module, etc.) or in different components in the terminal equipment, or, at least some modules / units can be implemented in the form of a software program, which runs on a processor integrated inside the terminal equipment, and the remaining (if any) modules / units can be implemented in hardware such as circuits.

[0115] The specific implementation methods described above further illustrate the purpose, technical solutions and beneficial effects of the embodiments of the present application. It should be understood that the above description is only the specific implementation method of the embodiments of the present application and is not intended to limit the protection scope of the embodiments of the present application. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the embodiments of the present application should be included in the protection scope of the embodiments of the present application.

Claims

1. A data collection method, characterized in that: include: Acquire first data; Determine characteristic information of each item of first data, wherein the characteristic information is determined according to the first data type information and / or size information; storing each item of the first data in a corresponding storage area according to the characteristic information; Determining source information and sending and receiving time information of each item of first data; In response to a keyword search instruction, calling first data matching the keyword from the storage area; Displaying first data matching the keyword and an interactive control, wherein the interactive control is used to display source information and sending and receiving time information of the first data matching the keyword; Wherein, determining the source information and the sending and receiving time information of each item of the first data includes: Acquire the associated information record of each first data from the associated information record list; Determine the source information and sending and receiving time information of each item of first data according to the associated information record of each item of first data; Determine whether the source information and the sending and receiving time information of each item of the first data can be identified, and obtain the identifiable source information and the sending and receiving time information; The tag information of the corresponding first data is determined according to the identifiable source information and the sending and receiving time information, so as to facilitate subsequent tracing according to the tag information.

2. The method according to claim 1, characterized in that The obtaining of the first data comprises: Establish data source; Each item of the first data is received from each data source.

3. The method according to claim 1, characterized in that The determining of characteristic information of each item of first data includes: Record valid characteristic information of each item of the first data, wherein the valid characteristic information includes type information and size information of each item of the first data, and determine the characteristic information according to at least one item of the valid characteristic information.

4. The method according to claim 1, characterized in that The storing each item of the first data into a corresponding storage area according to the characteristic information includes: Classify each item of first data according to the type information of each item of first data and / or the size information of each item of first data to obtain a data set corresponding to each type information and / or each size information; The data set corresponding to each type of information and / or each size of information is stored in a corresponding storage area according to a preset mapping relationship, and the preset mapping relationship is used to reflect the storage area corresponding to each type of information and / or each size of information.

5. The method according to claim 1, characterized in that After displaying the first data and the interactive control matching the keyword, the method further includes: In response to an interaction instruction for the interactive control, jump to a data source corresponding to source information of first data matching the keyword.

6. The method according to any one of claims 1 to 5, characterized in that: Each storage area is any one of a preset number of separate storage spaces divided by the storage disk.

7. A data collection device, characterized in that: It includes a receiving module, an analyzing module and a processing module, wherein: The receiving module is used to obtain the first data; The analysis module is used to determine feature information of each item of first data, wherein the feature information is determined according to the first data type information and / or size information; The processing module is used to store each item of the first data into a corresponding storage area according to the characteristic information; The processing module is further used to determine the source information and the sending and receiving time information of each item of the first data; in response to the keyword search instruction, call the first data matching the keyword from the storage area; display the first data matching the keyword and the interactive control, wherein the interactive control is used to display the source information and the sending and receiving time information of the first data matching the keyword; The processing module is also used to obtain the associated information record of each first data from the associated information record list; determine the source information and sending and receiving time information of each first data according to the associated information record of each first data; judge whether the source information and sending and receiving time information of each first data can be identified, and obtain the identifiable source information and sending and receiving time information; determine the tag information of the corresponding first data according to the identifiable source information and sending and receiving time information, so as to facilitate subsequent tracing according to the tag information.

8. An electronic device, characterized in that: include: A processor, a memory, and one or more programs; the one or more programs are stored in the memory and are configured to be executed by the processor, the programs comprising instructions for executing the steps in the method according to any one of claims 1-6.

9. A computer storage medium, characterized in that The computer storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 6.

Images