222 results about "Collection methods" patented technology

The invention discloses a dynamic log collection method and system and a server. According to the method, a flexible strategy configuration management system is introduced, user-defined configuration is supported, a plurality of target servers, different log files and different collection frequencies can be configured in one log collection strategy, and flexible collection strategies can be configured for different collection objects; in addition, in the method, strategies are automatically distributed, and the complexity of deployment and management is simplified; after the change of the file is monitored, the log file in the appointed path with the change is automatically collected, the automatic log collection and storage process reduces the requirement of manual operation, reduces the possibility of error occurrence, and improves the integrity and reliability of log data; in addition, the method supports the simultaneous storage of the logs in a plurality of target storage systems, such as a local file system, a cloud storage, a database and the like, so that the flexible configuration of log storage is realized.

The invention relates to a toxic text collection method and system based on retrieval enhancement generation, and the method comprises the steps: firstly obtaining target text data through a crawling platform, manually constructing a small-scale initial data set through a cold start mode, and injecting the initial data set into a knowledge base as basic data; and performing semantic retrieval on each batch of target texts, obtaining the first k texts with semantic similarity from the knowledge base, reasoning by adopting a plurality of large language models through thinking chain reasoning in combination with the texts, generating a toxic label, and labeling the target texts to be labeled in the current batch. And injecting the labeled target text into a knowledge base, continuously collecting and labeling data in an iteration mode, and continuously optimizing the performance of a retriever through an incremental learning mechanism in the iteration process so as to realize toxic text collection. According to the method, large-scale, fine-grained and high-consistency toxic text tagging corpora can be efficiently accumulated, and the problems of high tagging cost, inconsistent quality and poor expansibility in traditional toxic text data collection are remarkably relieved.

The invention discloses an eBPF-based log collection method, a medium and a system. The method comprises the following steps: S1, positioning a tracking point; s2, compiling an eBPF program based on the tracking points; s3, compiling and deducing the compiled eBPF program, and then loading the compiled eBPF program; s4, capturing information when the project program runs based on the eBPF program; s5, the captured information is written into the BPF Maps; and S6, the captured information is read from the BPF Maps and formatted. According to the method, on the premise that the system performance is not affected, key events can be directly captured on the kernel level, and valuable information is selectively collected; by defining a unified log format standard, the consistency and readability of log data are improved, and the troubleshooting efficiency and accuracy are enhanced; most log processing work is completed in a kernel space, dependence on user space resources is reduced, the storage performance overhead is effectively reduced, and the operation efficiency of the system is improved.

The invention discloses a call collection method and device based on a big language model, equipment and a medium, and relates to the technical field of financial credit loan, and the method comprises the steps: obtaining feature information and historical call records corresponding to a target debtor, obtaining a psychological portrait of the target debtor according to the big language model and the target historical call records, and based on an initial cue word; generating a to-be-verified collection strategy based on the initial prompt word and the psychological portrait, and performing compliance rule verification on the to-be-verified collection strategy to obtain a target collection strategy according to a verification result; carrying out collection by using the target collection strategy, recording a collection record in real time, and obtaining a repayment willingness of the target debtor by using the collection record; and judging whether the repayment willingness meets an expected condition or not, and ending the collection process of the target debtor according to a corresponding judgment result. The personalized collection strategy is generated according to the feature information of the debtor, and the collection strategy is verified, so that the compliance and effectiveness of the collection process are ensured.

Embodiments of the present disclosure provide a method, apparatus, electronic device, and storage medium for collecting media content. The method includes: in response to a collection operation on media content, adding the media content to the media content collection list of the current user, and displaying a favorites list of the current user, where the favorites list is used to display first identifiers of at least some of the current user's favorites; in response to a trigger operation on the first identifier, adding the media content to the favorite corresponding to the first identifier on which the trigger operation acts. By adopting the above technical solutions, the embodiments of the present disclosure can enrich the collection methods of media content.

The application provides a kind of interstitial water in-situ collection device, comprising: liquid collecting unit, pretreatment unit, sample unit, power unit and collection unit, one end of the collection unit is provided with penetration part;The liquid collecting unit is arranged in the collection unit, comprising a plurality of liquid pumping cabin distributed along the first direction;The liquid pumping cabin is provided with liquid pumping port and liquid inlet;The pretreatment unit is arranged on the outer wall of the collection unit, comprising first control assembly, sampling port corresponding to the liquid inlet;The sampling port is communicated with the liquid inlet;The first control assembly is used to control the opening and closing of the sampling port;The power unit comprises driving module, automatic pumping module.The in-situ collection device improves the efficiency and accuracy of interstitial water collection under the premise of meeting portability and low cost, continuously optimizes the working performance of stratified sampling.The application also provides an in-situ collection method for interstitial water with corresponding advantages.

The invention discloses an information collection method and device and electronic equipment, and belongs to the technical field of artificial intelligence. The method comprises the following steps: receiving collection input of program information in a program interface, wherein the program information comprises at least one of the following items: a file and a link; displaying an information collection interface in response to the collection input; wherein the information collection interface comprises a first collection option corresponding to the program information, and the first collection option comprises an information identifier of the program information and collection detail information of the program information; collection detail information in the information collection interface comprises at least one of the following items: a keyword of program information, at least one application icon, a collection source identifier and a sharing control, and the at least one application icon is an icon of an application program matched with a user intention; the user intention is obtained based on keyword prediction.

The embodiment of the invention discloses an intelligent data collection method and device, computer equipment and a storage medium. The data intelligent collection method is applied to the data intelligent collection system, the data intelligent collection system comprises an RPA assembly and a data processing large model, and the method comprises the steps that the RPA assembly obtains a webpage source code of a target webpage and sends the webpage source code to the data processing large model; the data processing large model determines a collection script of the RPA component according to the webpage source code, and sends the collection script to the RPA component; the RPA component performs multi-modal information collection on the target webpage based on the collection script to obtain multi-modal data corresponding to the target webpage; the large data processing model carries out data fusion and verification processing on the multi-modal data, and target webpage data corresponding to the target webpage are acquired. By implementing the method provided by the embodiment of the invention, the RPA component can dynamically adapt to the webpage structure change to automatically collect the webpage data.

The invention discloses a dynamic webpage content complete collection system and method based on a browser rendering engine. A CDP controller main module calls a command to start a headless browser process, and a network monitoring module registers a Network. Response Received event monitor; a DOM (Document Object Model) monitoring module starts a Mutation Observer to monitor the change of a DOM (Document Object Model) tree; the interactive simulation module preloads a mouse click and scroll event instruction set; capturing JSON / XML data returned by an interface in real time by using a network monitoring module, intercepting API response data, generating a DOM snapshot by using a DOM monitoring module, and extracting key structure changes; the DOM monitoring module provides a complete rendering HTML, the network monitoring module provides request metadata, and the interactive simulation module provides an operation time sequence log and packages generated complete webpage data into a WARC file. According to the method, document collection is upgraded to application-level interaction, and a technical implementation path is provided for collection scenes of dynamic data-intensive websites (such as financial public opinion monitoring and e-commerce price tracking) in which Internet resources are stored for a long time.

The invention provides an automatic master data collection method based on metadata, and relates to the technical field of data management, and the method comprises the following steps: based on metadata of various data sources, matching the metadata through a matching algorithm to obtain a corresponding relation of the metadata of different data sources; based on the corresponding relationship, establishing a standard model, and collecting the main data of the multiple data sources through the standard model in combination with a preset collection rule; according to the requirements of the business process, the operation specification and the data timeliness, the collection period and frequency of the timed task for collecting the main data are determined, and the collection period depends on the change speed of the data and the requirement of the business for the data freshness.

The invention discloses a film series intelligent dynamic collection method and device based on a multi-modal large model, and belongs to the technical field of film and television content processing, and the method comprises the steps: extracting text information, audio information and visual information of film and television content; the text information is analyzed to extract key semantic features, the audio information is analyzed to extract emotion tone features, the visual information is analyzed to extract image hue, shot language and scene composition visual style features, and multi-modal feature vectors are obtained; inputting the multi-modal feature vectors into a pre-trained artificial intelligence large model, and inferring an association relationship between the film and television contents and a series episode category to which the film and television contents belong in combination with a preset series episode structure rule base; and carrying out dynamic mapping comparison on the inferred incidence relation between the film and television contents and the category of the series with the stock series, and storing a comparison result. The collection efficiency and accuracy are improved, the labor cost is reduced, and the experience of watching the series of the user is improved.

The application relates to the technical field of electric digital data processing, in particular to a collection method based on a dynamic threshold value, equipment and a medium. The method comprises the following steps: obtaining a set of experimental crawler programs whose crawling results on a target data source are successful, which are included in an experimental collection group; obtaining a crawling success rate of each program in the set on a candidate data source in a candidate data source set; determining a crawling characteristic judgment index of the target data source according to the crawling success rate; if the index is greater than or equal to a preset judgment index threshold value, determining a collection power of the target data source according to a comparison result of a collection power index of the target data source and a preset collection power index threshold value, and collecting the target data source based on the collection power; otherwise, determining the collection power of the target data source according to a comparison result of the collection power index of the target data source and an updated collection power index threshold value. The application can dynamically adjust a decision threshold value, and balance resource efficiency and a collection success rate.

The application discloses a data bloodline collection method and device based on a Gbase stored procedure, and the method comprises the following steps: removing fixed keywords of a stored procedure definition process body; capturing a stored procedure variable through a regular expression and converting the stored procedure variable into a Key-Value form; replacing a variable name with a variable value according to the Key; processing a loop structure and a branch structure, and processing a self-defined label; and performing syntax compatibility and replacing or removing SQL statements according to some keywords. The application processes some general keywords of the stored procedure, removes redundant information irrelevant to the data bloodline, processes some syntaxes specific to the Gbase in a compatible manner, so that the syntaxes can be parsed by open-source SQL tools, and the application is adapted to the stored procedure of the Gbase, so that the application can help some manufacturers using the Gbase stored procedure to process data in an automatic form to the data bloodline, and the application is convenient for data warehouse construction.

The embodiment of the invention relates to a log collection method and device, equipment and a medium, and relates to the technical field of data processing, and the method comprises the following steps: obtaining a to-be-collected log corresponding to a target application program and a pre-constructed log feature library; performing comparison calculation based on the to-be-collected log and a log feature library, and judging whether the to-be-collected log belongs to a log category or not; when the to-be-collected logs belong to the log category, determining a target collection log from the to-be-collected logs according to a preset target proportion value to perform log collection; wherein the target proportion value is less than 1; and when the to-be-collected log does not belong to the log category, carrying out full-amount log collection on the to-be-collected log. According to the embodiment of the invention, the to-be-collected log is compared with the log feature library to judge that the to-be-collected log is the abnormal log, and the to-be-collected log is judged to be the normal log and is collected according to a certain proportion, so that the analysis volume of the normal log is reduced, the dynamic collection of the log is realized, and the log collection and analysis cost is reduced.

The invention discloses a file processing method and device, a coverage rate collection method and device, electronic equipment and a storage medium. The file processing method comprises the following steps: in response to a packaging instruction for a service source code of a target service, if it is determined that the packaging instruction comprises a target parameter, importing a dependent packet for the target service; the target parameter is used for indicating that the target service has a coverage rate acquisition requirement; the dependency package comprises a file for realizing code coverage rate collection on the target service; in response to successful import of the dependency package, processing the dependency package based on the service source code to obtain a coverage rate toolkit; and based on the business source code packaging result of the business source code and the coverage rate toolkit, determining a target installation package for the target business. According to the method, the deployment efficiency of the code coverage rate collection function is improved, the deployment cost of the code coverage rate collection function is reduced, and then the purposes of improving the coverage rate collection efficiency and reducing the coverage rate collection cost are achieved.

The present invention relates to the field of data processing technology, and specifically to a user big data collection method and system for e-commerce, comprising: obtaining the user's attention to each category of goods in each period based on the differences in the results of commodity keyword clustering in each period; obtaining the user's shopping demand trend for each category of goods based on the differences in the shopping demand change rate for each category of goods in different periods; obtaining the user's overall attention trend for each category of goods based on the shopping demand trend and demand change consistency for each category of goods; obtaining the e-commerce platform's collection rate for each category of goods based on the difference in the overall attention trend for each category of goods compared to other categories of goods; and optimizing the collection of user behavior data based on the e-commerce platform's collection rate for each category of goods. The present invention enhances the e-commerce platform's ability to respond to users' latest needs.

The application discloses a human core body temperature and inertia signal collection device and a collection method. The device comprises a first collection module, a second collection module, a third collection module, a fourth collection module, a bottom packaging layer, a top packaging layer and a core circuit module layer. The method comprises the following steps: step 1, setting the collection device at a relevant position and collecting position sensor data; step 2, inputting three groups of heat conduction layer temperatures and environmental temperatures into a prediction model for processing to obtain three groups of predicted core temperatures, and normalizing the three groups of predicted core temperatures to determine the core body temperature of the subject; and step 3, taking the inertia data of the third collection module as a reference value, processing the data of the first collection module and the second collection module to obtain corrected inertia measurement data. The application can provide reliable data for subsequent detection and diagnosis of human physiological mechanisms, and can also obtain physiological and action information of the human body from the inertia signal.

Embodiments of the present disclosure relate to an attribution collection method, device, equipment and medium, wherein the method comprises: when it is detected that a current workflow enters a preset node, a preset card point platform is called to obtain working data of a previous workflow; the card point platform is used to perform rule detection on the working data of the previous workflow based on at least one process rule corresponding to the previous workflow, to obtain a detection result; when the detection result is detection failure, the card point platform is used to respond to an attribution input operation, to display an attribution collection page based on a preset page address, and to obtain attribution data input by a user based on the attribution collection page. Through the setting of the card point platform, the present disclosure can not only quickly and efficiently perform rule detection on the working data of the historical workflow, but also save the time and effort of the collector. The collected person will not interrupt his normal work in the workflow, and the efficiency of attribution data collection is effectively improved.

The invention relates to an acquisition method and system supporting fingerprint acquisition at any window position. The method comprises the following steps: acquiring image data on a window; performing image processing on the acquired image data, identifying and positioning a fingerprint area in a window, and judging a dry and wet state of a fingerprint; parameters of acquisition equipment are adjusted according to the identified fingerprint area information and fingerprint dry and wet state information, and the parameters comprise the acquisition position of a CMOS sensor, the size of an acquired image, exposure time, a gain value, light source brightness and the like; the acquisition device acquires a fingerprint image according to the adjusted parameters; and carrying out adaptive contrast enhancement processing based on histogram analysis on the acquired fingerprint image. According to the invention, the fingerprint area position in the window can be identified in real time, and fingerprints can be collected at any window position; meanwhile, the system also has a fingerprint dryness and humidity detection function, optimizes parameters of acquisition equipment in real time, and ensures that the quality of the acquired fingerprint image is always kept at a relatively high level.

The invention relates to the technical field of computers and financial science and technology, and discloses a log collection method and device based on Runtime, a storage medium and computer equipment, the method is applied to a log collection application program of mobile equipment, and the method comprises the steps that the log collection application program is run, and a sub-process based on a Runtime class is created through the log collection application program; executing a preset log recorder command in the sub-process by using a method based on a Runtime class; extracting log entries matched with filtering conditions from the system log information through a log filter in the log collection application program; and taking the log entry as target log information. By creating the Runtime class-based sub-process and executing the preset log recorder command, real-time capture and remote analysis of background system log information can be realized, and meanwhile, by combining a log filter technology, log entries matched with filtering conditions can be accurately extracted, and the accuracy and integrity of target log information are ensured.

The system according to the embodiment aims to efficiently acquire information on collection methods for recyclable materials and recycle shops. [Solution] The system according to the embodiment comprises a reception unit, an analysis unit, an acquisition unit, a display unit, and a second display unit. The reception unit receives photographs of recyclable materials from the user. The analysis unit analyzes the photographs received by the reception unit and identifies the type of recyclable material. Based on the type of recyclable material identified by the analysis unit, the acquisition unit acquires collection rules for each municipality based on the entered address. The display unit displays the method of collecting the recyclable material based on the information acquired by the acquisition unit. The second display unit displays information on nearby recycling shops based on the information displayed by the display unit.

The application discloses a state information collection method and related components thereof, and relates to the field of task execution. When a collection task is being executed, a task for obtaining the current state of each hardware is executed in parallel. When it is determined that the current state of a hardware has changed, a first weight value of each preset virtual execution environment at the current time is determined. The first weight value is positively correlated with the idle degree and execution force of the preset virtual execution environment. The state information of the hardware whose current state has changed is collected by using the preset virtual execution environment with the highest first weight value. Since the task for obtaining the current state and the collection task are executed in parallel, the normal execution of the collection task is not affected. The state information is collected by using the preset virtual execution environment with the highest first weight value, so that the situation of redundant and complex collection process caused by collecting multiple state information is avoided, and the situation of collection task execution failure caused by too long execution time of the collection task is also avoided.

The invention discloses an automatic bidding and tendering knowledge collection method and system based on semantic analysis and a storage medium, and relates to the technical field of digital bid evaluation. Establishing a professional database in the bidding and tendering field, and constructing a bidding and tendering knowledge graph based on association relationships of various knowledge in the professional database; obtaining a to-be-collected bidding and tendering text, preprocessing the to-be-collected bidding and tendering text, inputting the to-be-collected bidding and tendering text into the trained NLP semantic classification model, performing semantic segmentation on the bidding and tendering text, and identifying domain entities, attributes, relationships and theme information in the text; generating a corresponding semantic classification label according to the semantic analysis result; and inputting the semantic classification labels into the tendering and bidding knowledge graph, automatically extracting knowledge contents in the text in combination with the semantic classification labels, and classifying the knowledge contents into corresponding knowledge modules to complete automatic collection of knowledge. According to the method, the problems of low efficiency, poor accuracy and low standardization of current bidding and tendering knowledge collection are solved, and efficient and accurate support is provided for knowledge management.

This warehouse management method is for managing a warehouse, and includes: a step for acquiring operation range information indicating an operation range of a picking robot which performs picking work on an article; a step for acquiring dropping position information indicating a dropping position which is a position where a first article was dropped from the picking robot, and dropping time information indicating a dropping time which is the time at which the first article was dropped from the picking robot; a step for acquiring arrangement state information indicating an arrangement state of a moving body the position of which moves within the warehouse; and a step for determining collection information related to a collection method for the first article, on the basis of the operation range of the picking robot, the dropping position and the dropping time of the first article, and the arrangement state of the moving body at the dropping time.

A simple and stable method by which samples in different forms can be acquired at once from a blood sample. A method for collecting microorganisms that comprises: introducing a blood sample 200 into a first storage part 100 of a container 1, said container 1 being provided with the first storage part 100 having a first flow path 103 and a second flow path 104 of different heights on the side face, a second storage part 101 and a third storage part 102; centrifuging the blood sample 200 at a first centrifugal force to separate into a bacterial solution 202 containing microorganisms and a solution 203 containing blood cells; centrifuging the blood sample 200 at a second centrifugal force greater than the first centrifugal force and moving the solution 203 through the first flow path 103 to the second storage part 101; centrifuging the second solution 203 at a third centrifugal force to separate into a bacterial solution 206 containing microorganisms and blood components 207 containing blood cells; and centrifuging the solution 203 at a fourth centrifugal force greater than the third centrifugal force and moving the bacterial solution 206 through the second flow path 104 to the third storage part 102.

The invention provides a large-model-based secret language collection method and device, equipment and a storage medium, and relates to the technical field of computers, in particular to the technical fields of artificial intelligence, large models, public opinion control, secret language recognition, risk content management and control and the like. According to the specific implementation scheme, a candidate content set is obtained based on seed expansion related to a secret language; screening candidate contents in the candidate content set by using a large model to obtain candidate secret words; performing retrieval enhancement on the basis of the candidate secret words to obtain a retrieval result; and screening the retrieval results by using a large model to obtain the to-be-collected secret words and explanations thereof.

The invention provides a configuration information acquisition method and system and a medium, the configuration information acquisition method comprises the following steps: determining whether an automatic probe can be deployed on a device, the automatic probe comprising a preset program, the preset program comprising an acquisition rule for a component in the device, and the acquisition rule comprising an acquisition frequency and a data acquisition range; when it is determined that the equipment can deploy the automatic probe, deploying the automatic probe for the equipment, and enabling the automatic probe to collect component configuration information according to the collection rule; and when determining that the equipment cannot deploy the automatic probe, acquiring component configuration information through the application program interface and / or the access configuration library. Through the method, accurate acquisition and batch acquisition of the component configuration information of any component can be realized.

The purpose of the embodiments of the present disclosure is to provide a digital resource collection method, system and computer program product for scientific museums. Wherein, first JSON-LD data is generated for each access data; based on the first JSON-LD data, explicit technical features are extracted from the original feature metadata to generate first type labels, and semantic information in the standardized basic metadata is parsed to generate second type labels, forming second JSON-LD data; based on the second JSON-LD data, a pre-defined rule template is loaded according to the type label to extract structured metadata, and a reference to the original access data is retained, forming third JSON-LD data; based on the third JSON-LD data, supplementary metadata is generated, forming fourth JSON-LD data; based on the fourth JSON-LD data of each access resource, an association is established between the metadata of different access resources, forming fifth JSON-LD data of each access resource.