Method for shortening access time of API (Application Program Interface) and system applied by same

Abstract

The method for shortening the access time of the API comprises six processes. A system applied by the method for shortening the access time of the API comprises a registration module, a data uploading and receiving module, a data updating module, a virus detection module, a priority distribution module, a prompt module and an analysis module. Under the combined action of related module units and application method processes, data in a data supermarket library can be self-checked, abnormal virus data and useless data can be cleared, speed interference of viruses on a data interface, data loss and the like caused by the viruses are reduced, and the service life of the data supermarket library is prolonged under the same network speed. The data in the database can be updated and iterated in real time, and it is guaranteed that the data obtained by an application end through an interface has better practicability and accuracy; different terminal clients can be ranked according to levels, the priority clients can preferentially obtain data, and favorable technical support is provided for users to effectively and timely obtain various data.

Description

Technical Field

[0001] The present invention relates to the technical field of data supermarket management terminal system application, in particular to a method for shortening API interface data acquisition time and an application system thereof. Background Art

[0002] Data Supermarket is a full-stack development service platform that integrates data "sharing, development, production, circulation, trading, and safe use". It covers asset types such as data sets, data services, analysis models, AI models, BI reports, and provides a variety of service forms such as retrieval and subscription transactions. The main functions of Data Supermarket include: (1) Data asset portal: integrates different types of data assets, provides multi-level authorization management, and provides stable asset services. (2) Personal center: provides users with a personal space to view the data information they have applied for or collected, and intelligently recommends data products that users are interested in. (3) Asset catalog: helps users quickly find the required data assets through flexible and diverse organizational methods (such as by business domain, by data source, and by data type). (4) Asset management: quickly create and publish data assets on the asset catalog, provide complete permissions and approval mechanisms, and ensure data security and compliance. Data Supermarket plays an important role in the digital construction of global enterprises, and can realize various digital applications in a low-cost, short-cycle, and high-efficiency manner. It is not only an outlet for the value transformation of data assets, but also can enhance data consumption capabilities and enable business digitalization.

[0003] Although the existing data supermarkets have met people's demand for data to a certain extent, they are still subject to technical limitations and the following technical problems exist. In the data supermarket data retrieval process, data is read from the API (interface) applied by the user in the data supermarket through Python code, and then sorted and fed back to the user. As the user's data application needs increase, the amount of data retrieved from the interface has also increased from a few hundred at the beginning to millions. When the amount of data is large, the corresponding data retrieval time also increases exponentially, which makes it difficult to meet the user's timeliness requirements for data retrieval and use. In addition, the existing data supermarket cannot judge the accessed data and whether there is malicious use and destruction of data on the application side, and cannot effectively guarantee the normal operation of the data supermarket. Summary of the invention

[0004] In order to overcome the drawbacks of the existing data supermarkets as described in the background technology due to technical limitations, the present invention provides a method for shortening the API interface data retrieval time and its application system, which provides technical support for users to effectively and timely obtain various data, and can self-check the data in the data supermarket library, clear abnormal virus data and useless data, and update and iterate the data in the database in real time under the joint action of relevant module units and application method processes, thereby shortening the time for terminal users to obtain data, ensuring that the data obtained by the application end has better practicality, and can also sort different terminal customers according to their levels. Priority customers can obtain data first, which provides favorable technical support for users to effectively and timely obtain various data.

[0005] The technical solution adopted by the present invention to solve the technical problem is:

[0006] The method for shortening the time of obtaining data through an API interface includes the following process, step S1: a person who needs to use a digital supermarket registers information on the registration interface of the data supermarket, and chooses to become a paid user or a free user according to the page prompt; S2: when a user operates a PC to process data, the latest data involved in his own industry can be uploaded to the cloud through the data upload interface of the data supermarket, and the data uploaded by multiple users form a user-side database; S3: the data supermarket crawls the Internet through a network crawler module, and classifies the multiple data by category, so that the user can access and use the data; S4: virus detection is performed on multiple data in the database at regular intervals, and anti-virus treatment is performed on the data after the virus is detected;

[0007] S5: When the user terminal obtains data from the database, during the time period when the data supermarket network is smooth and the data transmission is fast, the user's Internet device that obtains the data will not be limited. During the time period when the network is delayed and the data transmission is slow, different users will be provided with data transmission at different speeds according to the priority of the user terminal. When necessary, the data interface for non-paying users can be temporarily interrupted to ensure that priority customers can obtain data first and the corresponding user terminals can obtain better data fast interface services; S6: During the time period when the data supermarket network is delayed and the data transmission is slow, the reasons are analyzed and the time for non-paying users to use the data supermarket interface in the future is given.

[0008] Furthermore, in step S1, the information registration includes the unit and personal information, contact information, industry information of the registrant, and which priority data information matches the industry.

[0009] Furthermore, in step S2, after the latest data related to the industry is uploaded to the cloud, the cloud will analyze the uploaded data. When the data is outdated or there are virus risk factors, the user can be prompted through the user-side PC interface, and the corresponding data will not be received or stored.

[0010] Furthermore, in step S3, the data supermarket crawls the Internet corresponding to a variety of latest data through a web crawler module. The methods are divided into scheduled and irregular data crawling. The crawled data can generate a list according to time. The data supermarket maintenance personnel can understand the corresponding data in real time and delete useless data when the crawled data is unreasonable.

[0011] Furthermore, in step S4, the infected virus type and anti-virus information data can be sent to the data supermarket maintenance end, and the maintenance end can update the anti-virus program of the data supermarket in real time according to the virus type and infection probability to ensure the effectiveness of anti-virus.

[0012] Furthermore, in step S5, for users with higher payment amounts, data is obtained faster via the Internet device interface.

[0013] Furthermore, in step S6, the time when the non-paying user obtains the data supermarket interface is a historical stage when there are few corresponding interfaces in the data supermarket.

[0014] The system for applying the method for shortening the data acquisition time of an API interface comprises a registration module, a data upload and receiving module, a data update module, a virus detection module, a priority allocation module, a prompt module and an analysis module. The registration module and the data upload and receiving module are application software installed in an Internet device at a user end of a data supermarket; the data update module, the virus detection module, the priority allocation module, the prompt module and the analysis module are application software installed in a cloud; the registration module, the data upload and receiving module, the data update module, the virus detection module, the priority allocation module, the prompt module and the analysis module are interconnected via the Internet.

[0015] Furthermore, the registration module provides a registration function for the data supermarket user terminal, the data upload and receiving module provides the user terminal with data upload and data receiving functions of the cloud data supermarket, the data update module controls the network crawler module to crawl network data, the virus detection module is used for data detection and disinfection in the data supermarket database, the priority allocation module is used for time periods with large user interface volume, network delay and slow data transmission, and controls the access of different users to the data supermarket interface with priority levels, the analysis module is used to analyze the reasons for slow data transmission of the data supermarket interface, and the prompt module is used to prompt the user terminal for the best time period to receive data.

[0016] Furthermore, the priority allocation module limits the data transmission speed of the interface data of underpaid and non-paid users according to the level on the basis that the data transmission can satisfy the normal data acquisition of priority customers, so as to enable different users to access the interface of the data supermarket in the corresponding time period as much as possible.

[0017] Compared with the prior art, the present invention has the following advantages: (1) under the joint action of relevant module units and application method processes, the present invention can perform self-inspection on the data in the data supermarket library, clear abnormal virus data and useless data, reduce the interference of viruses on the speed of the data interface and cause data loss, etc., and shorten the time for terminal users to obtain data at the same network speed; (2) the data in the database can be updated and iterated in real time to ensure that the data obtained by the application end through the interface has better practicality and accuracy; (3) different terminal customers can be sorted according to their levels, and priority customers can obtain data first, which provides favorable technical support for users to effectively and timely obtain various data and improves the efficiency of the data supermarket operation end. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a flowchart of a method for shortening the API interface data acquisition time of the present invention. DETAILED DESCRIPTION

[0019] The system for shortening the time of API interface data acquisition includes a registration module, a data upload and receiving module, a data update module, a virus detection module, a priority allocation module, a prompt module, and an analysis module. The registration module, the data upload and receiving module are application software installed in the Internet device of the data supermarket user end; the data update module, the virus detection module, the priority allocation module, the prompt module, and the analysis module are application software installed in the cloud; the registration module, the data upload and receiving module, the data update module, the virus detection module, the priority allocation module, the prompt module, and the analysis module are interconnected through the Internet. The registration module provides a registration function for the data supermarket user end, the data upload and receiving module provides the user end with data upload and cloud data supermarket data receiving functions, the data update module controls the network crawler module to crawl network data, the virus detection module is used for data detection and disinfection in the database of the data supermarket, the priority allocation module is used for the time period when the user interface is large, the network delay and the data transmission is slow, and the priority level access control of the data supermarket interface is performed for different users, the analysis module is used for the reason analysis of the slow data transmission of the data supermarket interface, and the prompt module is used for prompting the user end for the best time period to receive data. The priority allocation module can limit the speed of data transmission for user interface data that has paid less or not paid, based on the data transmission being able to meet the normal data acquisition needs of priority customers, so as to enable different users to access the data supermarket interface in the corresponding time period as much as possible.

[0020] Figure 1As shown, the method for shortening the API interface data acquisition time includes the following process, step 1: through the registration module, the management personnel who need to use the digital supermarket register information on the registration interface of the data supermarket of the intelligent Internet device (including PC, smart phone or tablet computer, etc.), and choose to become a paid user or a free user according to the page prompt; specifically, the information registration includes the unit and personal information of the registered personnel, contact information, and the industry information and the information of which priority data to match the industry; after the information is registered, the user end can access the interface of the data supermarket, and can track and process malicious users (users who upload useless data or viruses). Step 2: When the user end operates the intelligent Internet device to process the data supermarket with different categories of data, the latest data involved in its own industry can be uploaded to the cloud through the data upload interface of the data supermarket of the intelligent Internet device through the data upload and receiving module, and the data uploaded by multiple users forms the user end database, and the data is more diversified; specifically, after the latest data involved in its own industry is uploaded to the cloud, the cloud will analyze the uploaded data, and when the data is backward or there are virus and risk factors, the user can be prompted through the user end PC interface, and the corresponding data will not be received or stored. Step 3: Through the data update module, the data supermarket crawls the Internet through the web crawler module to obtain the latest data corresponding to the various types of data, and classifies the various types of data by category, so that the user can access and use the data and enrich the content of the database; the data supermarket crawls the Internet through the web crawler module, and its own data corresponds to the latest data corresponding to the various types of data, and the crawling method is divided into scheduled and irregular crawling data. The crawled data can generate a list according to time. The maintenance personnel of the data supermarket can understand the corresponding data in real time, and delete the useless data when the crawled data is unreasonable. Step 4: Through the virus detection module, the various data in the database are regularly tested for viruses, and the virus is disinfected after the virus is detected; the infected virus type and anti-virus information data can be sent to the data supermarket maintenance end. The maintenance end can update the anti-virus program of the data supermarket in real time according to the type of virus and the probability of infection, to ensure the effectiveness of anti-virus, and ensure the smooth and safe operation of the data supermarket. Step 5: Through the priority allocation module, when the user terminal obtains data in the database, during the time period when the data supermarket network is smooth and the data transmission is fast, the user's Internet device that obtains the data will not be limited. During the time period when the network is delayed and the data transmission is slow, different users are provided with data transmission at different speeds according to the priority of the user terminal. When necessary, the data interface of non-paying users can be temporarily interrupted to ensure that priority customers can obtain data first and the corresponding user terminal can obtain better data fast interface services; for users with higher payment amounts, the time to obtain data through the Internet device interface is faster.Step 5: Through the prompt module and the analysis module, during the period of network delay and slow data transmission in the data supermarket, the causes are analyzed, and the time for non-paying users to use the data supermarket interface is given; the time when non-paying users get to use the data supermarket interface is a historical stage when there are few corresponding interfaces in the data supermarket.

[0021] Through the above technical scheme, the present invention, under the joint action of relevant module units and application method processes, can self-check the data in the data supermarket library, clear abnormal virus data and useless data, reduce the speed interference of viruses on the data interface and cause data loss, etc., and shorten the time for terminal users to obtain data at the same network speed: the data in the database can be updated and iterated in real time to ensure that the data obtained by the application end through the interface has better practicality and accuracy; different terminal customers can be sorted according to their levels, and priority customers can obtain data first, which provides favorable technical support for users to effectively and timely obtain various data, and improves the efficiency of the data supermarket operation end. It should be noted that the present invention is not limited to data supermarket technology, and can be applied to data security management of any software system.

[0022] The above content gives the basic principles and main features of the present invention and the advantages of the present invention. It is obvious to those skilled in the art that the present invention is limited to the details of the above exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or basic features of the present invention. Therefore, no matter from which point of view, the embodiments should be regarded as exemplary and non-restrictive. The scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention.

[0023] In addition, it should be understood that although the present specification is described according to the implementation mode, the implementation mode does not only include an independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in the embodiments can also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. A method for shortening the API interface data acquisition time, characterized in that: The process includes the following steps: step S1: the person who needs to use the digital supermarket registers information on the registration interface of the data supermarket, and chooses to become a paid user or a free user according to the page prompt; S2: when the user operates the PC to process data, he can upload the latest data related to his own industry to the cloud through the data upload interface of the data supermarket, and the data uploaded by multiple users form a user-side database; S3: the data supermarket crawls the Internet through the network crawler module, and classifies the various data by category for the user to access and use the data; S4: virus detection is performed on various data in the database at regular intervals, and the virus is detected. Antivirus processing; S5: When the user end obtains data in the database, during the time period when the data supermarket network is smooth and the data transmission is fast, the user's Internet device that obtains the data will not be limited. During the time period when the network is delayed and the data transmission is slow, different users will be provided with data transmission at different speeds according to the priority of the user end. When necessary, the data interface for non-paying users can be temporarily interrupted to ensure that priority customers can obtain data first and the corresponding user end can get better data fast interface service; S6: During the time period when the data supermarket network is delayed and the data transmission is slow, the reasons are analyzed and the time for non-paying users to use the data supermarket interface in the future is given.

2. The method for shortening the API interface data acquisition time according to claim 1 is characterized in that: In step S1, the information registration includes the unit and personal information, contact information, industry information of the registrant, and which priority data information matches the industry.

3. The method for shortening the API interface data acquisition time according to claim 1, characterized in that: In step S2, after the latest data related to the industry is uploaded to the cloud, the cloud will analyze the uploaded data. When the data is outdated or there are virus risk factors, the user can be prompted through the user-side PC interface and the corresponding data will not be received or stored.

4. The method for shortening the API interface data acquisition time according to claim 1, characterized in that: In step S3, the data supermarket crawls the Internet corresponding to various latest data through the web crawler module. The methods are divided into scheduled and irregular data crawling. The crawled data can generate a list according to time. The data supermarket maintenance personnel can understand the corresponding data in real time and delete useless data when the crawled data is unreasonable.

5. The method for shortening the API interface data acquisition time according to claim 1 is characterized in that: In step S4, the infected virus type and anti-virus information data can be sent to the data supermarket maintenance end, and the maintenance end can update the anti-virus program of the data supermarket in real time according to the virus type and infection probability to ensure the effectiveness of anti-virus.

6. The method for shortening the API interface data acquisition time according to claim 1, characterized in that: In step S5, for users with higher payment amounts, data is obtained faster via the Internet device interface.

7. The method for shortening the API interface data acquisition time according to claim 1, characterized in that: In step S6, the time when the non-paying user obtains the data supermarket interface is a historical stage when there are few corresponding interfaces in the data supermarket.

8. A system for applying the method for shortening the API interface data acquisition time according to any one of claims 1 to 7, characterized in that: It includes a registration module, a data upload and receiving module, a data update module, a virus detection module, a priority allocation module, a prompt module, and an analysis module. The registration module and the data upload and receiving module are application software installed in the Internet device of the data supermarket user end; the data update module, the virus detection module, the priority allocation module, the prompt module, and the analysis module are application software installed in the cloud; the registration module, the data upload and receiving module, the data update module, the virus detection module, the priority allocation module, the prompt module, and the analysis module are interconnected via the Internet.

9. The system for applying the method for shortening the API interface data acquisition time according to claim 8 is characterized in that: The registration module provides registration function for the data supermarket user terminal, the data upload and receiving module provides the user terminal with data upload and data receiving functions of the cloud data supermarket, the data update module controls the network crawler module to crawl network data, the virus detection module is used to detect and disinfect data in the data supermarket database, the priority allocation module is used for time periods with large user interface volume, network delay and slow data transmission, and controls the access of different users to the data supermarket interface with priority levels, the analysis module is used to analyze the reasons for slow data transmission of the data supermarket interface, and the prompt module is used to prompt the user terminal for the best time period to receive data.

10. The system for applying the method for shortening the API interface data acquisition time according to claim 8 is characterized in that: The priority allocation module limits the data transmission speed of the interface data of users who have paid less or not according to the level, based on the data transmission being able to meet the normal data acquisition needs of priority customers, so as to enable different users to access the interface of the data supermarket in the corresponding time period as much as possible.

Images