13results about How to "Reduce access pressure" patented technology

The invention provides a double-way buffering mechanism design method for Web services. Two buffering mechanisms based on dynamic pages and static pages perform double-way reading and writing through a database and an xml buffering file, synchronous operation is performed to trigger updated buffering mechanisms, an xml buffering module is used as a using library when a user accesses, a database in an application system is used as a standby library, and reading and writing operations of data are finished in the xml buffering file; and the design content comprises a management process, a reading process and a write-in process of a double-way buffering mechanism. The double-way buffering mechanism design method has the advantages that by means of the dynamic and static combined double-way buffering mechanism, timeliness and accuracy of a system in mass data processing can be improved to a large extent, and performances and service qualities of a Web server are improved.

Embodiments of the present application disclose a cache control method, device, equipment and medium. The method comprises: obtaining a target access heat of cached data; controlling a storage address of the cached data to be added to a target array according to the target access heat; and updating the cached data in a cache area according to the storage address in the target array. The above scheme introduces the target access heat, updates the storage address in the target array, and then updates the cached data in the cache area in stages, thereby avoiding the influence of cache area avalanche on the database and reducing the access pressure of the database. Meanwhile, the above scheme reduces unnecessary occupation of cache resources, improves the use efficiency of cache resources, and is convenient to operate and has small computational complexity.

The invention relates to a Chinese webpage data acquisition and processing system and method, the system comprises an acquisition module, a data transmission module, a data processing module, a scheduling module and a data storage module, and the method comprises the following steps: the scheduling module puts seed url / url of sites with different weights into a task queue; the acquisition module reads the url to be acquired in the task queue, accesses internet data by initiating a network request, and writes responded webpage data into a kafka message queue in the data transmission module in a structured manner; the data storage module generates a corresponding jsonl.gz file from the webpage data through the data in the consumption data transmission module and uploads the file to s3 for storage; and the data processing module reads the html data in the s3 storage through spark, and carries out url extraction, pagerank calculation and combined deduplication processing. Compared with the prior art, large-scale and high-quality Chinese data acquisition processing and storage can be realized, and the method has the advantages of high acquisition efficiency, accurate duplicate removal, high timeliness, flexible configuration and the like.

The invention relates to a data processing method and device, electronic equipment and a storage medium, and the method comprises the steps: responding to a detected access instruction of an object, and generating an agent of the object according to the type of the object; monitoring an operation event on the object according to the proxy of the object; and responding to the operation on the object according to the operation event. Through the scheme, the access to the object through the proxy can be realized, and the method and the device have relatively high universality.

The embodiment of the invention discloses a task processing message method and device, electronic equipment and a storage medium. The method comprises the steps of determining first task association information of at least one to-be-processed sub-task associated with a task processing message under the condition that the task processing message is detected; wherein the affiliation users corresponding to the at least one to-be-processed sub-task have differences; for the at least one to-be-processed sub-task, determining a task return path of the to-be-processed sub-task according to the first task associated information of the to-be-processed sub-task and at least two pre-generated service libraries, and returning a task value attribute value corresponding to the to-be-processed sub-task to the target processing account based on the task return path; wherein the service library is used for storing return paths of all tasks associated with the user. According to the technical scheme of the embodiment of the invention, the access pressure on the business library is relieved, the hot spot problem of the business library is avoided, and the task processing efficiency is improved.

The invention discloses a method for preventing cache breakdown, a source station gateway, a product, equipment and a storage medium, and relates to the field of data caching, and the method comprises the steps: calling a preset interference parameter elimination script to carry out interference parameter elimination on an initial parameter string of each interface request, the method comprises the following steps: acquiring a parameter string only comprising a source station access condition parameter corresponding to a uniform resource identifier, splicing the uniform resource identifier and the parameter string, acquiring a resource unique identifier corresponding to each interface request, and accessing a source station based on the resource unique identifier. And sending the obtained resource request result to a sending end of each interface request corresponding to the resource unique identifier. According to the method and the device, the interference parameters in the initial parameter string are eliminated, so that the influence of randomly changed parameters in the parameter string on the cache hit rate is avoided, and the resource request results corresponding to the plurality of interface requests with the same resource unique identifier can be obtained only by accessing the source station for one time based on the resource unique identifier; and the access pressure to the source station is reduced.

The embodiment of the invention provides a method and system for reducing response delay of cloud collection data and a medium, and the method comprises the steps: obtaining the equipment composition of an energy storage station, and obtaining the real-time state information of each equipment based on the equipment composition; based on the real-time state information, extracting a collector SN, all device names and device field information, and generating a binding relationship between the device and the collector; obtaining configuration classification numbers of all devices, extracting cloud protocol configuration information of the devices, analyzing real-time state information of the devices, and processing the real-time state information into structured data; analyzing the structured data to obtain analyzed data, and storing the analyzed data to a cache server and a real-time database; the data in the cache server is displayed to the PC terminal and the mobile terminal in real time; by adding the cache server, the access pressure of the database is greatly reduced, meanwhile, the data repetition judgment logic is added to the cloud, the data storage cost can be reduced, and the use experience of a user is greatly improved.

The application relates to a member benefit data query method and device, a storage medium and electronic equipment. The method comprises the following steps: when a member benefit query request is received, a Bloom filter is called to perform existence judgment on a target member benefit identifier in the member benefit query request; in the case that the target member benefit identifier does not exist in a member benefit identifier set as judged by the Bloom filter, a benefit invalid result is directly returned; in the case that the target member benefit identifier may exist in the member benefit identifier set as judged by the Bloom filter, the target member benefit identifier is sequentially queried in a cache layer and a database to obtain corresponding member benefit data and return the data; in the case that the target member benefit identifier is not queried in the cache layer and the database, a benefit invalid result is returned, and a null value of the target member benefit identifier is written in the cache layer and an effective period is set. The application solves the technical problem that the prior art lacks an efficient existence prediction mechanism.

The embodiments of the present disclosure disclose a method for storing information, a method for obtaining information, an apparatus, a device and a medium. A specific implementation of the method for storing information includes: receiving a request for storing information, the request for storing information includes information to be shared; generating first description information and an information storage address according to the information to be shared, the first description information is used to describe the information content of the information to be shared; in response to generating the first description information, generating information sharing constraints corresponding to the first description information; storing the information sharing constraints, the first description information, and the information storage address in the blockchain; in response to receiving a confirmation signal of successful storage, sending a storage success message. This implementation realizes the secure storage of data and is conducive to data management.

The invention discloses a user blacklist management method and system based on a multi-level deployment architecture, and relates to the technical field of information. The method comprises the following steps that a multi-stage communication system containing a user organization is created, and different types of communication software and corresponding user management services and file transmission services are deployed in nodes of each stage in the multi-stage communication system; formulating a user blacklist and communication strategy information corresponding to each level of node in the multi-level communication system based on the user management service; user blacklists and communication strategy information of all levels of nodes are summarized upwards level by level to a center node for collection and combination based on file transmission service; and distributing the collected and combined user blacklist and communication strategy information to each level of node for updating step by step based on a file transmission service. According to the invention, user blacklist management and information transmission of a multi-level deployment architecture are realized, and unnecessary interference to work of a specific user group is avoided.

The invention relates to an information updating method and device, a readable medium, electronic equipment and a program product, and the method comprises the steps: determining a to-be-executed operation message and a drawing board state in a database, and enabling the drawing board state to comprise node data and a node tree relation in a drawing board, executing a target operation on the node data and / or the node tree relationship in the memory according to the operation message to obtain target node data, the target node data being node data of a target node of which the node data and / or the node tree relationship are / is changed after the operation message is executed, and the target node data being node data of a target node of which the node data and / or the node tree relationship are / is changed after the operation message is executed. And updating the node data of the target node in the database into the target node data. Therefore, when the drawing board state in the database is updated, only the node data of the target node in the database needs to be updated, and the intermediate data does not need to be updated, so that on one hand, the access frequency of the database can be reduced, the access pressure of the database is reduced, and on the other hand, the updating speed of the drawing board state in the database can be increased; and the page loading speed is increased.

The embodiment of the invention provides a data processing method and device for a storage cache system, equipment and a medium, and the method comprises the steps: when a write operation instruction for a target object is received, creating a snapshot object for a cache object corresponding to the target object in a cache according to data and metadata carried by the write operation instruction, updating a cache object corresponding to the target object in the cache; persistently storing the cache object and the snapshot object corresponding to the target object; when a read operation instruction for the target object is received, the data of the target object is read from at least one of the cache object in the cache, the snapshot object in the cache, the persistently stored cache object and the persistently stored snapshot object, so that the access speed in a high-concurrency environment is improved, and the access pressure on a rear-end storage system is relieved.

The invention belongs to the technical field of intelligent pest killing, and particularly relates to an intelligent control cloud system for pest control. Comprising a gateway service module, a registration service module, a user authentication service module, a management service module, a workflow service module, a cloud file service module, a structure configuration service module, a report service module, an automatic service module and a log service module. According to the intelligent control cloud system for pest control, through integration of a plurality of micro-service modules such as the gateway service module, the registration service module and the user authentication service module, high-degree modular design is realized, the system can be flexibly expanded and updated through the design, each module can be independently developed and deployed, and the system is convenient to use. According to the micro-service system, the complexity and the maintenance cost of the system are reduced, and meanwhile, the micro-services are mutually called through lightweight interfaces, so that the maintainability and the expandability of the system are improved, the system can quickly adapt to continuously changing requirements, and intelligent management and data integration and utilization are realized.