124 results about "Collection methods" patented technology

The invention relates to a toxic text collection method and system based on retrieval enhancement generation, and the method comprises the steps: firstly obtaining target text data through a crawling platform, manually constructing a small-scale initial data set through a cold start mode, and injecting the initial data set into a knowledge base as basic data; and performing semantic retrieval on each batch of target texts, obtaining the first k texts with semantic similarity from the knowledge base, reasoning by adopting a plurality of large language models through thinking chain reasoning in combination with the texts, generating a toxic label, and labeling the target texts to be labeled in the current batch. And injecting the labeled target text into a knowledge base, continuously collecting and labeling data in an iteration mode, and continuously optimizing the performance of a retriever through an incremental learning mechanism in the iteration process so as to realize toxic text collection. According to the method, large-scale, fine-grained and high-consistency toxic text tagging corpora can be efficiently accumulated, and the problems of high tagging cost, inconsistent quality and poor expansibility in traditional toxic text data collection are remarkably relieved.

The application provides a kind of interstitial water in-situ collection device, comprising: liquid collecting unit, pretreatment unit, sample unit, power unit and collection unit, one end of the collection unit is provided with penetration part;The liquid collecting unit is arranged in the collection unit, comprising a plurality of liquid pumping cabin distributed along the first direction;The liquid pumping cabin is provided with liquid pumping port and liquid inlet;The pretreatment unit is arranged on the outer wall of the collection unit, comprising first control assembly, sampling port corresponding to the liquid inlet;The sampling port is communicated with the liquid inlet;The first control assembly is used to control the opening and closing of the sampling port;The power unit comprises driving module, automatic pumping module.The in-situ collection device improves the efficiency and accuracy of interstitial water collection under the premise of meeting portability and low cost, continuously optimizes the working performance of stratified sampling.The application also provides an in-situ collection method for interstitial water with corresponding advantages.

The embodiment of the invention discloses an intelligent data collection method and device, computer equipment and a storage medium. The data intelligent collection method is applied to the data intelligent collection system, the data intelligent collection system comprises an RPA assembly and a data processing large model, and the method comprises the steps that the RPA assembly obtains a webpage source code of a target webpage and sends the webpage source code to the data processing large model; the data processing large model determines a collection script of the RPA component according to the webpage source code, and sends the collection script to the RPA component; the RPA component performs multi-modal information collection on the target webpage based on the collection script to obtain multi-modal data corresponding to the target webpage; the large data processing model carries out data fusion and verification processing on the multi-modal data, and target webpage data corresponding to the target webpage are acquired. By implementing the method provided by the embodiment of the invention, the RPA component can dynamically adapt to the webpage structure change to automatically collect the webpage data.

The invention discloses a dynamic webpage content complete collection system and method based on a browser rendering engine. A CDP controller main module calls a command to start a headless browser process, and a network monitoring module registers a Network. Response Received event monitor; a DOM (Document Object Model) monitoring module starts a Mutation Observer to monitor the change of a DOM (Document Object Model) tree; the interactive simulation module preloads a mouse click and scroll event instruction set; capturing JSON / XML data returned by an interface in real time by using a network monitoring module, intercepting API response data, generating a DOM snapshot by using a DOM monitoring module, and extracting key structure changes; the DOM monitoring module provides a complete rendering HTML, the network monitoring module provides request metadata, and the interactive simulation module provides an operation time sequence log and packages generated complete webpage data into a WARC file. According to the method, document collection is upgraded to application-level interaction, and a technical implementation path is provided for collection scenes of dynamic data-intensive websites (such as financial public opinion monitoring and e-commerce price tracking) in which Internet resources are stored for a long time.

The invention discloses a film series intelligent dynamic collection method and device based on a multi-modal large model, and belongs to the technical field of film and television content processing, and the method comprises the steps: extracting text information, audio information and visual information of film and television content; the text information is analyzed to extract key semantic features, the audio information is analyzed to extract emotion tone features, the visual information is analyzed to extract image hue, shot language and scene composition visual style features, and multi-modal feature vectors are obtained; inputting the multi-modal feature vectors into a pre-trained artificial intelligence large model, and inferring an association relationship between the film and television contents and a series episode category to which the film and television contents belong in combination with a preset series episode structure rule base; and carrying out dynamic mapping comparison on the inferred incidence relation between the film and television contents and the category of the series with the stock series, and storing a comparison result. The collection efficiency and accuracy are improved, the labor cost is reduced, and the experience of watching the series of the user is improved.

The application relates to the technical field of electric digital data processing, in particular to a collection method based on a dynamic threshold value, equipment and a medium. The method comprises the following steps: obtaining a set of experimental crawler programs whose crawling results on a target data source are successful, which are included in an experimental collection group; obtaining a crawling success rate of each program in the set on a candidate data source in a candidate data source set; determining a crawling characteristic judgment index of the target data source according to the crawling success rate; if the index is greater than or equal to a preset judgment index threshold value, determining a collection power of the target data source according to a comparison result of a collection power index of the target data source and a preset collection power index threshold value, and collecting the target data source based on the collection power; otherwise, determining the collection power of the target data source according to a comparison result of the collection power index of the target data source and an updated collection power index threshold value. The application can dynamically adjust a decision threshold value, and balance resource efficiency and a collection success rate.

The application discloses a data bloodline collection method and device based on a Gbase stored procedure, and the method comprises the following steps: removing fixed keywords of a stored procedure definition process body; capturing a stored procedure variable through a regular expression and converting the stored procedure variable into a Key-Value form; replacing a variable name with a variable value according to the Key; processing a loop structure and a branch structure, and processing a self-defined label; and performing syntax compatibility and replacing or removing SQL statements according to some keywords. The application processes some general keywords of the stored procedure, removes redundant information irrelevant to the data bloodline, processes some syntaxes specific to the Gbase in a compatible manner, so that the syntaxes can be parsed by open-source SQL tools, and the application is adapted to the stored procedure of the Gbase, so that the application can help some manufacturers using the Gbase stored procedure to process data in an automatic form to the data bloodline, and the application is convenient for data warehouse construction.

The invention discloses a file processing method and device, a coverage rate collection method and device, electronic equipment and a storage medium. The file processing method comprises the following steps: in response to a packaging instruction for a service source code of a target service, if it is determined that the packaging instruction comprises a target parameter, importing a dependent packet for the target service; the target parameter is used for indicating that the target service has a coverage rate acquisition requirement; the dependency package comprises a file for realizing code coverage rate collection on the target service; in response to successful import of the dependency package, processing the dependency package based on the service source code to obtain a coverage rate toolkit; and based on the business source code packaging result of the business source code and the coverage rate toolkit, determining a target installation package for the target business. According to the method, the deployment efficiency of the code coverage rate collection function is improved, the deployment cost of the code coverage rate collection function is reduced, and then the purposes of improving the coverage rate collection efficiency and reducing the coverage rate collection cost are achieved.

The application discloses a human core body temperature and inertia signal collection device and a collection method. The device comprises a first collection module, a second collection module, a third collection module, a fourth collection module, a bottom packaging layer, a top packaging layer and a core circuit module layer. The method comprises the following steps: step 1, setting the collection device at a relevant position and collecting position sensor data; step 2, inputting three groups of heat conduction layer temperatures and environmental temperatures into a prediction model for processing to obtain three groups of predicted core temperatures, and normalizing the three groups of predicted core temperatures to determine the core body temperature of the subject; and step 3, taking the inertia data of the third collection module as a reference value, processing the data of the first collection module and the second collection module to obtain corrected inertia measurement data. The application can provide reliable data for subsequent detection and diagnosis of human physiological mechanisms, and can also obtain physiological and action information of the human body from the inertia signal.

Embodiments of the present disclosure relate to an attribution collection method, device, equipment and medium, wherein the method comprises: when it is detected that a current workflow enters a preset node, a preset card point platform is called to obtain working data of a previous workflow; the card point platform is used to perform rule detection on the working data of the previous workflow based on at least one process rule corresponding to the previous workflow, to obtain a detection result; when the detection result is detection failure, the card point platform is used to respond to an attribution input operation, to display an attribution collection page based on a preset page address, and to obtain attribution data input by a user based on the attribution collection page. Through the setting of the card point platform, the present disclosure can not only quickly and efficiently perform rule detection on the working data of the historical workflow, but also save the time and effort of the collector. The collected person will not interrupt his normal work in the workflow, and the efficiency of attribution data collection is effectively improved.

The invention relates to an acquisition method and system supporting fingerprint acquisition at any window position. The method comprises the following steps: acquiring image data on a window; performing image processing on the acquired image data, identifying and positioning a fingerprint area in a window, and judging a dry and wet state of a fingerprint; parameters of acquisition equipment are adjusted according to the identified fingerprint area information and fingerprint dry and wet state information, and the parameters comprise the acquisition position of a CMOS sensor, the size of an acquired image, exposure time, a gain value, light source brightness and the like; the acquisition device acquires a fingerprint image according to the adjusted parameters; and carrying out adaptive contrast enhancement processing based on histogram analysis on the acquired fingerprint image. According to the invention, the fingerprint area position in the window can be identified in real time, and fingerprints can be collected at any window position; meanwhile, the system also has a fingerprint dryness and humidity detection function, optimizes parameters of acquisition equipment in real time, and ensures that the quality of the acquired fingerprint image is always kept at a relatively high level.

The system according to the embodiment aims to efficiently acquire information on collection methods for recyclable materials and recycle shops. [Solution] The system according to the embodiment comprises a reception unit, an analysis unit, an acquisition unit, a display unit, and a second display unit. The reception unit receives photographs of recyclable materials from the user. The analysis unit analyzes the photographs received by the reception unit and identifies the type of recyclable material. Based on the type of recyclable material identified by the analysis unit, the acquisition unit acquires collection rules for each municipality based on the entered address. The display unit displays the method of collecting the recyclable material based on the information acquired by the acquisition unit. The second display unit displays information on nearby recycling shops based on the information displayed by the display unit.

The invention discloses an automatic bidding and tendering knowledge collection method and system based on semantic analysis and a storage medium, and relates to the technical field of digital bid evaluation. Establishing a professional database in the bidding and tendering field, and constructing a bidding and tendering knowledge graph based on association relationships of various knowledge in the professional database; obtaining a to-be-collected bidding and tendering text, preprocessing the to-be-collected bidding and tendering text, inputting the to-be-collected bidding and tendering text into the trained NLP semantic classification model, performing semantic segmentation on the bidding and tendering text, and identifying domain entities, attributes, relationships and theme information in the text; generating a corresponding semantic classification label according to the semantic analysis result; and inputting the semantic classification labels into the tendering and bidding knowledge graph, automatically extracting knowledge contents in the text in combination with the semantic classification labels, and classifying the knowledge contents into corresponding knowledge modules to complete automatic collection of knowledge. According to the method, the problems of low efficiency, poor accuracy and low standardization of current bidding and tendering knowledge collection are solved, and efficient and accurate support is provided for knowledge management.

The invention provides a large-model-based secret language collection method and device, equipment and a storage medium, and relates to the technical field of computers, in particular to the technical fields of artificial intelligence, large models, public opinion control, secret language recognition, risk content management and control and the like. According to the specific implementation scheme, a candidate content set is obtained based on seed expansion related to a secret language; screening candidate contents in the candidate content set by using a large model to obtain candidate secret words; performing retrieval enhancement on the basis of the candidate secret words to obtain a retrieval result; and screening the retrieval results by using a large model to obtain the to-be-collected secret words and explanations thereof.

The purpose of the embodiments of the present disclosure is to provide a digital resource collection method, system and computer program product for scientific museums. Wherein, first JSON-LD data is generated for each access data; based on the first JSON-LD data, explicit technical features are extracted from the original feature metadata to generate first type labels, and semantic information in the standardized basic metadata is parsed to generate second type labels, forming second JSON-LD data; based on the second JSON-LD data, a pre-defined rule template is loaded according to the type label to extract structured metadata, and a reference to the original access data is retained, forming third JSON-LD data; based on the third JSON-LD data, supplementary metadata is generated, forming fourth JSON-LD data; based on the fourth JSON-LD data of each access resource, an association is established between the metadata of different access resources, forming fifth JSON-LD data of each access resource.

The invention provides a data full-flow vulnerability collection method and apparatus, a device, a storage medium and a product. The method comprises the steps of obtaining a historical work record; the historical work record comprises work stage time sequence information of the target object; based on the working stage time sequence information of the target object, determining the proportion of target junction points in each preset time period; the target handover point is a handover time point between a following stage and a previous stage of the following stage in the historical work record, and the following stage is a stage following the current stage of the target object in the historical work record; predicting the next stage of the target object from a plurality of following stages based on the proportion of the target intersection points in each preset time period; and when the current stage is completed, performing data full-flow vulnerability collection on the target object by adopting the predicted vulnerability scanning tool corresponding to the next stage. According to the method, more matched vulnerability scanning tools can be used in different stages of the target network and the system, and the overall vulnerability scanning effect is improved.

Embodiments of the present application disclose a log collection method, a client, a terminal, a server and a storage medium. The client sends a collection request corresponding to a target application to a server; wherein the collection request carries target data corresponding to the target application and a target address; the target address is a storage address corresponding to the server or a storage address corresponding to the client; the server sends a collection rule corresponding to the target application; the target application is collected according to the collection rule to obtain target log corresponding to the target data; and the target log is stored in the target address. The server receives the collection request sent by the client; wherein the collection request carries the target data corresponding to the target application and the target address; the collection rule corresponding to the target application is created according to the target data and the target address; and the collection rule is sent to the client to realize collection of the target log corresponding to the target data.

The application provides a log burying point collection method and system, wherein the method comprises the following steps: determining a log data source, collecting log burying point data from the log data source, and storing the log burying point data into a source data storage module; based on a preset reading period, reading the log burying point data in the source data storage module in a timing manner, performing blacklist filtering on the log burying point data, and obtaining an effective event set and an effective field set; when there is a new field in the effective field set, constructing a new field statement, encapsulating and storing the new field statement into a field metadata storage table; and when there is a new event in the effective event set, constructing a table building statement, encapsulating and storing the table building statement into a table metadata storage table; and executing the new field statement and / or the table building statement. Through the application, changes in engineering logs can be automatically perceived, the logs can be deeply analyzed, key information can be accurately extracted, and a highly adaptive data model can be automatically constructed, so that the efficiency, accuracy and adaptability of modeling are greatly improved.

A big data-based intelligent traffic information collection method, system, medium and equipment, relating to the technical field of data collection. The method comprises: obtaining historical collection records of each collection device in a target traffic network, grouping each collection device based on the historical collection records, and obtaining a plurality of collection device groups; obtaining working state information of each collection device in the collection device group; determining a complementary collection device group for each collection device group; and determining a data collection strategy for each collection device group based on the working state information of each collection device and the complementary collection device group. The technical solution provided by the present application improves the timeliness of traffic information transmission and realizes the rational scheduling of collection resources.

The invention relates to the technical field of file collection, and provides a high-performance file collection method and device. A file monitoring probe monitors a data source node to obtain metadata of a to-be-collected file in the data source node, and sends the metadata to a main execution node; the master execution node maps the metadata to a corresponding slave execution node so as to establish an actual collection task for the to-be-collected file at the slave execution node; the slave execution node downloads the to-be-collected file from the data source node to complete the actual collection task, and the problems that in the prior art, collection time delay is high, a butt joint interface is complex, and a file system event mechanism is depended on are solved.

The invention discloses a digital currency collection method and device, and relates to the field of digital currency payment. A specific embodiment of the method comprises the following steps: in response to a collection operation of a user, sending a target wallet identifier and a collection amount corresponding to the collection operation to a background system; receiving a limit auditing result sent by the background system, confirming that the limit auditing result indicates that the collection amount meets a collection limit requirement corresponding to the target wallet identifier, and obtaining payment wallet information; sending a collection request to a background system; and receiving a collection result sent by the background system, the collection result being generated after the background system performs digital currency collection according to the collection request. According to the implementation mode, a convenient digital currency collection mode is provided for the merchant user, and the threshold of using the digital currency to carry out merchant collection is reduced.

The invention discloses a collection method and electronic equipment, and the method comprises the steps: adding a user order and a collection code to a mapping relation of an intelligent contract of a network under the condition that the user order and the collection code sent by a business system are received; performing uplink storage on the added mapping relation; distributing a collection address for the user order according to the smart contract; packaging the collection address and the collection code into collection information and sending the collection information to a service system; when it is monitored that an entry event exists in the collection address, the order state of a user order corresponding to a collection code is determined according to the collection code carried by the entry event and the mapping relation stored on the chain; under the condition that the order state of the user order is to-be-paid, verifying an entry event according to the acquiring information; and if the verification passes the order state of the mapping relation stored on the update chain, notifying the business system of successful collection. The method has the advantages and characteristics of improving the address reuse rate, solving the address reuse delay, ensuring the transaction safety and improving the account checking efficiency.

Embodiments of the present application disclose an application log collection method, device, equipment and storage medium. The method comprises the following steps: in response to starting of a target application, loading a log collection agent file associated with the target application; adjusting original log collection statements in an original bytecode file of the target application through bytecode adjustment statements in the log collection agent file, to obtain target log collection statements capable of collecting target log data in a running process of the target application; and obtaining logs in the running process of the application in accordance with business requirements by adjusting the bytecode of the application. The method does not need to modify source code of the application, solves the technical problem that the source code is not reusable in the prior art, does not need to depend on or inherit a log class of the application, solves the problems that the prior art is highly invasive and has high complexity, and the method can collect required logs by loading the log collection agent file, and has low performance loss.

The invention discloses an intelligent collection method and device based on audio analysis, and is applied to the technical field of data processing.The method comprises the steps that multi-mode audio analysis serves as the core, and basic information such as debtor credit data and legal document templates is collected and stored in a structured mode; call audio is transferred into a text stream with a timestamp in real time through an ASR technology, and audio framing, voice activity detection and other features are synchronously extracted. Through semantic, acoustic feature and dialogue rhythm three-dimensional analysis, a communication strategy and a switching threshold are determined by a multi-modal fusion and strategy decision engine, an adaptive verbal skill is generated, and a conversation link is established through a third-party platform. The debtor feedback is analyzed in real time, the verbal skill is dynamically adjusted until an effective result is obtained, finally key information such as committed repayment is extracted, a compliance legal document is automatically generated and sent out through one key after manual auditing, and whole-process intelligent collection is achieved.

The application provides an intelligence agent adaptive collection method and system based on long memory and long-time scheduling, and relates to the technical field of data processing.The method comprises the following steps: step 1, receiving an intelligence collection task, analyzing task parameters to construct a target object image, extracting and standardizing target features, and forming a structured target image; step 2, based on the structured target image, abstracting past similar tasks into experience triples and performing vectorization coding to store in an experience library, constructing a semantic retrieval index to implement hierarchical storage management; matching similar experiences from the experience library through semantic retrieval, and combining similarity and past success rate to generate an adaptive collection strategy. The application realizes continuous and stable execution of long-period intelligence collection tasks, and improves the collection success rate and recovery efficiency in a dynamic confrontation environment.

The application discloses a kind of excrement collecting device and collecting method, it is related to biological sample collection technical field, including closestool body, be provided with closestool cover and closestool ring, sample temporary storage passage is provided in closestool body, sample tube is provided in sample temporary storage passage;Sampling device, including sampling membrane and sampling arm, sampling membrane is laid below closestool ring, the end of sampling arm is provided with sampling head;Driving mechanism is set in closestool body, driving mechanism is used to drive sampling arm to move;Identity recognition module includes code scanning equipment and a plurality of pressure sensors;Central control module, the data collected is sent to the information system of hospital;By integrating automatic sampling device, identity recognition module and central control module, non-contact excrement collection is realized, the problems of patient psychological resistance, inconvenient operation and pollution risk in traditional method are solved, with the advantages of improving patient compliance, reducing pollution risk, simplifying operation process and ensuring timely sample collection.

According to the printing equipment information collection method, system and equipment provided by the embodiment of the invention, a collector collects equipment information of printing equipment in real time and stores the equipment information in a local database; after a user starts any collector, the server sends an information transmission instruction to the corresponding collector, and the server is linked with each collector through a network; after the information transmission instruction is received, the collector sends the equipment information to the server; and the server generates an equipment management page based on the equipment information, and the equipment management page is used for managing each collector connected with the server and each printing equipment associated with each collector. In the embodiment of the invention, the collectors are separated from the server, different collectors are arranged in different areas, the equipment information is collected in real time, the server generates the equipment management page based on the equipment information, and unified management of the printing equipment is realized.