86 results about "Delimiter" patented technology

The invention discloses a tracking data compression method and system, which are used for solving the technical problem that the existing tracking data compression technology mostly depends on a universal lossless compression algorithm for data compression, so that the tracking data compression effect is limited. The method comprises the following steps: acquiring a plurality of historical tracking span data, and preprocessing the plurality of historical tracking span data to generate a plurality of historical universal fields and a plurality of historical local fields; constructing a dictionary and a span retrieval tree by adopting a Hash algorithm according to the plurality of historical universal fields and the plurality of historical local fields; and when multiple pieces of to-be-compressed tracking span data are received, compressing the multiple pieces of to-be-compressed tracking span data by adopting the dictionary and the preset separators based on the path node sequence of the span retrieval tree to generate target compressed data.

The present disclosure provides a method for processing data and service system thereof. The present disclosure comprises a steps for receiving a plurality of data from one or more users, wherein the plurality of data includes text in a source language. The present disclosure further comprises steps for storing the plurality of data in a delimited format, wherein the plurality of data is arranged in one or more rows and one or more columns based on the plurality of information associated with one or more users, wherein the data in the one or more rows and the one or more columns are stored in the form of one or more cells comprising one or more characters. The present disclosure further comprises steps for identifying the cell with largest character count from the one or more rows and selecting the row corresponding to the identified cell. The present disclosure further comprises steps for determining if the source language of the selected row is a non-English text; and in response to determining that the selected row is a non-English text, transmitting the selected row to a data translation engine for conversion from source language to target language.

The invention provides a method and a device for identifying repeated and similar texts, computer equipment and a storage medium. The method comprises the following steps: extracting different characters of a to-be-detected text to obtain a divider set composed of a plurality of dividers; extracting a single segmentation symbol from the segmentation symbol set, or extracting a plurality of adjacent characters comprising the segmentation symbol from the text to be detected, and constructing a segmentation mark; segmenting the to-be-detected text by using the segmentation mark to obtain a character string list comprising at least two segmented character strings; extracting features of each character string in the character string list to obtain a feature list corresponding to the character string list; counting the continuous and same occurrence times of the features in the feature list; and when the occurrence frequency meets a preset frequency requirement, determining whether the to-be-detected text contains repeated similar texts or not according to the character string list. According to the invention, automatic detection and recognition of repeated similar texts in a large-model application scene can be realized.

The present invention discloses a method, device, equipment and medium for automatically processing a non-standardized log structure. The method comprises: identifying a target log to be processed, and when it is determined that the target log is a non-standardized log structure according to an automatic parsing rule, performing feature abstraction and aggregation to obtain an abstract key-value pair string; identifying a target separator in the abstract key-value pair string; identifying a missing character position and a missing character type in the abstract key-value pair string according to the target separator, and filling in a supplementary character matching the missing character type at the matching missing character position in the target log to obtain a standardized log structure. The technical solution of the embodiment of the present invention obtains a standardized log structure by identifying missing characters and automatically filling in the missing characters, and avoids the problem of low efficiency in the prior art that only regular expressions can be used to parse non-standardized log structures.

The present application relates to the field of communications, and provides a data processing method and a related device, which are capable of reducing data transmission bandwidth. The method comprises: a first apparatus acquiring first information, wherein the first information indicates to send a first sequence, the first sequence comprises an inter-frame gap, a first subsequence, and a start of frame delimiter, a length of the first sequence is less than a first threshold, a first byte of the first subsequence is used for indicating a start of a data sequence, and the data sequence comprises the first subsequence and the start of frame delimiter; and sending the sequence.

In an aspect, a method of coding a data stream is provided. In an aspect, the method includes mapping, by a data stream encoder, bits into one or more delimiters for the data stream while limiting a maximum run-length of a same polarity of bits in the data stream to be no more than 5. Each of the one or more delimiters include a zero bit and a one bit appended to an 8b / 10b codeword of one or more 8b / 10b codewords in the data stream. In an aspect, the method further includes transmitting, by a transmitter, the one or more delimiters in the data stream.

Disclosed herein are system, method, and computer program product embodiments for a template XSLT (extensible stylesheet language transformation) based NETCONF (network configuration protocol) data collector. An embodiment operates by sending, by a network management device, a NETCONF request to a first network element and a first network element, where the NETCONF request is generated based on a configuration file corresponding to the first network element and the first network element. The embodiment generates a stylesheet corresponding to the NETCONF configuration file. The embodiment receives a first NETCONF reply message and a second NETCONF reply message, where the first NETCONF reply message is generated by the first network element in response to receiving the NETCONF request, and the second NETCONF reply message is generated by the first network element in response to receiving the NETCONF request. The NETCONF reply message and the second NETCONF reply message are transformed into a delimited data format using the stylesheet.

A system and method guide an Artificial Intelligence engine to determine the semantic and grammatical correctness of a user-expanded sentence in real-time. The sentence validation process involves receiving input from the user, the input includes sentence fragment that the user wishes to expand and user-expanded sentence that the user constructs on the fragment provided. The inputs are broken down into tokens. The word-level tokenization algorithm is used, which identifies tokens by splitting the text into spaces, punctuation marks, and other delimiters. Further, a token comparison algorithm is used to assess the relationship between the sentence fragment and the user-expanded sentence to analyze order and placement. Once the token comparison is complete, a prompt is generated using prompt generator to evaluate grammatical and semantic evaluation of the user-expanded sentence. Real-time feedback is provided to the user based on grammatical and semantic evaluation.

A decoding device comprises a decoding processing unit that decodes a plurality of codewords included in an input codeword sequence while switching a codebook or an analysis tree that is to be used for decoding among a plurality of codebooks or analysis trees. The decoding processing unit determines a codebook or an analysis tree that is to be used for decoding a second codeword next to a first codeword included in the input codeword sequence in accordance with the first codeword and the codebook or the analysis tree used for decoding the first codeword. However, in cases where the first codeword is a delimiter codeword that is a specific codeword, the decoding processing unit determines the codebook or the analysis tree that is to be used for decoding the second codeword to be a specific codebook or analysis tree corresponding to the delimiter codeword regardless of the codebook or the analysis tree used for decoding the first codeword.

The invention discloses an analysis method based on an improved longest common subsequence, and belongs to the field of computer science. The method comprises the steps that firstly, a list LCSMap is created to store a plurality of data structures LCSObject, each LCSObject is used for storing a sequence LCSseq and a row index list lineIds, and the sequence LCSseq is the longest common subsequence LCS of a plurality of log entries; receiving log entries and processing the log entries into a token sequence by using a system separator; pre-filtering the token sequence: searching for a prefix tree, searching for an improved inverted list, searching for an improved cycle, establishing the token sequence, and storing the token sequence in a corresponding data structure LCSObject; if the pre-filtering fails, creating a new data structure LCSObject, and taking a log entry as a sequence LCSseq; according to the method, relatively low analysis time consumption can be kept on large-volume log data, and the accuracy of log analysis is not lost.

The present invention reduces template errors due to log parsing by causing a computer to execute: a parsing procedure for parsing, into partial character strings, a portion that can be parsed into a fixed portion and a variable portion which are included in a log, using as a delimiter a blank, a symbol with no alphabet letters or numbers, or a capital alphabet letter; a determination procedure for determining, for each of the partial character strings, whether the partial character string is a variable portion, on the basis of whether the partial character string includes a number in a prescribed mode, or whether the partial character string is present in a prescribed corpus; and a replacement procedure for replacing a partial character string determined to be a variable portion with a character string indicating the variable portion.

The invention relates to a data storage method, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring original data, and carrying out system coding on the original data to obtain an initial character string; under the condition that an unstable character string is recognized from the initial character string, first separators are inserted into the initial position and the end position of the unstable character string respectively, and a second separator is inserted between any two adjacent characters in the unstable character string to form a target character string; on the basis of a preset separator index rule, the first separator and the second separator, separator index information is generated; and writing the separator index information into a preset index position of the target character string, and writing the target character string containing the separator index information into a preset storage position. By adopting the method, the storage space can be saved and the storage efficiency can be improved.

The present invention discloses a log processing method, system, device and storage medium. In the embodiments of the present application, by using the regular expressions in the parser list, the first device log is first masked to cover the information that needs to be covered, which can effectively avoid the situation where the delimiter wrongly splits the information that should be a whole, without the need to write regular expressions for processing manually, helping to reduce the difficulty of device log parsing and improve the efficiency of log parsing. In addition, since the masked content is unknown to the delimiter, when there are missing or out-of-order fields corresponding to the masked part, it does not affect the subsequent log splitting. Therefore, to a certain extent, it can overcome the problems of being sensitive to missing fields and field order in the related art.

The invention discloses an automobile electronic control basic software code generation method, device and equipment and a storage medium, and relates to the technical field of automobile production and manufacturing, the method comprises the following steps: constructing a template grammar, and creating a template engine according to the template grammar so as to convert a code template file into an m language file; and compiling a code template file corresponding to the target automobile electronic control software based on the template grammar, and calling the template engine to process the code template file so as to realize code generation. The template grammar is used for realizing definition of separators; the separators comprise code separators, expression separators, meta command separators and others; and others are used for representing that text which is not among the code separators, the expression separators and the meta-command separators is output as well. According to the invention, the generation of the automobile electronic control software code can be effectively realized.

This invention discloses an automatic Syslog log parsing method, comprising: collecting Syslog log messages; removing header information and retaining the message body content, parsing it into a string set, and determining a delimiter; using the delimiter to segment the Syslog log message body content into a string array; confirming whether a key exists in the string array; classifying the strings, if a key exists, classifying the logs according to the key and data length; if no key exists, checking the data type and classifying the logs according to the array length and data type; automatically generating parsing templates for different log categories, using the parsing templates to extract the value corresponding to each field, and performing subsequent field mapping or transformation normalization processing. Using this invention, regular expression parsing of Syslog logs can be generated quickly, saving significant manpower.

The application provides a kind of based on SSE's stream data processing display method, system and related equipment, method includes based on the preset parameter construction and initiates HTTP request, establishes the SSE connection with server;In the data stream of the SSE connection, continuously receive data segment and append to data buffer;The data buffer is scanned and identified pre-defined message separator, to extract one or more independent SSE message from the data buffer and store in message queue;From the message queue, the SSE message is obtained, and the SSE message is split into character sequence and stored in character queue;According to the preset timer, periodically take out single or multiple characters from the character queue, render the character to user interface.The application realizes the smooth typewriter display effect by constructing double-layer queue rendering technology, and improves the response performance of SSE stream data in complex business scenarios.

This invention discloses a hierarchical perception-based method and system for analyzing complex English sentences, relating to the interdisciplinary fields of natural language processing and intelligent education. By defining structural delimiters, sentences are divided into syntactic levels according to the number of effective delimiters, first eliminating invalid parallel structural delimiters; then, a syntactic encoding module completes text segmentation, hierarchical tagging, word embedding, and feature fusion; a hierarchical perception module calculates feature weights and generates target syntactic features; finally, a syntactic decoding module outputs the sentence's main body and modifier decomposition results. The hierarchical framework constructed by this invention fully covers the core modifiers of English, is suitable for the scenario of complex sentences in the College Entrance Examination (Gaokao), and can achieve accurate and lightweight decomposition of all types of complex sentences. It effectively solves the problems of irregular decomposition, poor generalization, and poor adaptability of traditional methods, and the analysis process is clear and teachable.

Various aspects of the disclosure relate to automated conversion or transformation of data received from a plurality of sources, and of any format, into forms compatible as input to an application computing system. The data conversion platform identifies a format of an input data file or structure and imports characters, both printable and non-printable, from the input file and stores the imported characters as a string. The data conversion platform generates from the string data to an array of strings based on delimiters or other special characters. The data conversion platform applies a pattern model to the array string to identify patterns of data and stores matches as a second array of strings. The second array of strings is compared to a match file to identify bindings between input data and desired output data. These matches are then formatted as output data and communicated to the desired application for processing.

The present invention relates to the field of computer technology, and discloses a method for associating cigarette carton and strip two-dimensional code information with a multi-point verification function. By means of a better scheme, the head and tail positioning codes of the cigarette carton and strip two-dimensional code information are determined. At the same time, at reasonable verification positions and with better data repair, the rejection of strips caused by the failure of associating strip information due to the existence of unreadable records in the carton code queue and the failure of reading at the carton code verification station is greatly reduced, and the yield is increased. Using a phase insertion delimiter does not require reducing the decoding time.

The invention provides a text processing method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a to-be-processed document; the to-be-processed document comprises a plurality of training samples; splitting each training sample in the to-be-processed document to obtain at least one sentence corresponding to each training sample; if the length of the sentence is greater than the preset cut-off length, segmenting the sentence according to separators in the sentence to obtain a plurality of clauses corresponding to the sentence; wherein the length of each clause is smaller than or equal to a preset cut-off length; and if the length of the sentence is smaller than the preset cut-off length, performing sentence splicing on the sentence and other sentences except the sentence in the training sample to obtain a semantic coherent spliced sentence with the length smaller than or equal to the preset cut-off length. According to the method, the problems of sentence component loss, semantic incoherence and the like during text processing can be avoided, so that adverse effects on model training are avoided.

The present invention relates to a method and apparatus for high-performance analysis of delimiter format files. The method includes: sampling control characters in an input file in an iterative manner to determine the symbol state and logical position of the control characters; determining the character conversion level to be selected in a finite state transducer model according to the control characters, where the character conversion levels include a record level and a field level; splitting the input file into text blocks of equal size and placing them in idle processing units, implementing parallel scanning based on the finite state transducer model, and using SIMD to accelerate the recognition of delimiters to generate a bitmap index; performing queries based on the bitmap index, including a keyword search query mode and a file union query mode. The present invention realizes parallel processing at the thread level and instruction level, solves the speed bottleneck problem that the processing of CSV files is limited by the inherent format and can only be serially processed, and improves the processing speed.

Provided are a medical information processing device, a method for operating a medical information processing device, and a program which can provide support for creating a new medical text.A sentence input by a user is acquired in response to the input. Switching of an attribute of information described in the sentence is determined as a delimiter of the sentence. A structuration process is performed for each unit delimited by the delimiter. The determination is ended according to an end of creation of a medical text including one or more of the sentences. A result of the structuration process is output.

The invention discloses an end-to-end speech separation algorithm based on a speech language model, and the algorithm comprises the steps: discretizing a continuous audio into a 32-order discrete codebook sequence through a residual vector quantization coder-decoder, and introducing a transcription start symbol lt through an SOT strategy; sOSgt, SOSgt; a special separator is lt; sCgt; and a termination symbol lt; eOSgt, EOSgt; splicing a multi-person voice sequence; extracting audio depth features by using a pre-trained WavLM model, and guiding an autoregression decoder to output a separated zero-order codebook sequence in combination with a cross attention mechanism; predicting a high-order codebook sequence step by step through a non-autoregression model, configuring an independent embedding layer to fuse low-order information, and introducing a task embedding mechanism to optimize modeling; based on a special separator lt; sCgt; and slicing the multi-order discrete codebook sequence, and outputting an independent voice source through an Encodec decoder. According to the method, the intelligibility of voice separation and the audio restoration quality can be effectively improved, the decoding speed is high, the subjective hearing experiment result and the downstream task performance are excellent, the scene that the number of speakers is unknown is supported, and the industrialization application prospect is wide.

Methods, systems, and media for lot classification are disclosed. In one example, a classification system for identifying lot listings receives a description for a listing in a publication system, identifies a string in the listing, identifies a quantity word or digit in the string, and converts an identified quantity word into digit form. A normalized string is tokenized to produce tokens, the tokenizing of the normalized string including splitting the normalized string into a series of substrings using a sequence of delimiters. For each substring, an additional split is performed by separating any digit from any other adjacent character, unless that character is another digit, and maintaining an internal character order of each split substring to produce a flattened list of tokenized tokens.

The invention belongs to the technical field of software deployment in a Linux environment, and particularly relates to a method for integrating a Linux environment deliverable with a matched Shell script, which comprises the following steps of: firstly, setting a unique mark at the tail of the Shell script, and marking the mark as a character string which cannot appear in a script text; then adding the content of the deliverable to the tail of the Shell script file to form a single file entity; and the step S1 and the step S2 are executed repeatedly, and separators are inserted before and after each delivery. In the initial part of the Shell script, searching a position separator arranged in the script by using a text search tool; and extracting the deliverables in the two separators into the system, and finally executing the text part of the Shell script to complete deployment and configuration of one or more deliverables. The script and the deliverable are organically integrated, and the deployment efficiency, accuracy and reliability are improved.

The invention discloses a diffusion enhancement relation-based triple extraction method, which comprises the following steps of: 1) inputting a Chinese text into a BERT model, and converting the Chinese text into a corresponding index to obtain word embedding information; 2) inputting word embedding information into a triple diffusion model, and performing noise addition, feature fusion and de-noising processing to obtain a predicted triple; 3) inputting word embedding information into the character feature extraction network model, learning semantic information through a multi-layer perceptron and a double-affine attention mechanism in combination with relative position coding and a multi-head attention module, relieving a label imbalance problem by adopting a word embedding disturbance mechanism, and outputting a relation triple matrix; and 4) respectively decoding the triads obtained in the two steps, and taking union sets to obtain a final relation triad. According to the method, the boundary diffusion information and the character-level semantic information are fused, so that the problems that Chinese semantics are complex, natural separators are lacked, small-field data semantics extraction is insufficient, extraction of a traditional decoding method is incomplete, labels are unbalanced and the like are effectively solved, the accuracy and integrity of Chinese relation triple extraction and model stability are remarkably improved, and the method is suitable for large-scale popularization and application. The method is suitable for various natural language processing application scenes such as information questions and answers and search engine optimization.

The application discloses a kind of aspect sentiment quadruple prediction methods and systems for dialogue scene, it is related to deep learning technical field.The method includes: obtaining dialogue set;Using the preset dialogue line segmentation algorithm, dialogue set and the semantic label corresponding to dialogue set are split according to different dialogue lines, generate dialogue line set;Constitute completion gap prompt template;The completion gap prompt template and splicing text are connected by separator, obtain input sequence;Using the sequence generation model trained to encode and decode input sequence, generate target sequence;Target sequence is converted into sentiment quadruple, obtain candidate quadruple set;Candidate quadruple set is merged, and the sentiment quadruple set predicted on dialogue level is generated.The application can guarantee the context continuity of dialogue text semantics, effectively alleviate the length limit of model input text, improve the accuracy of generating quadruple.

The invention discloses a log compression method and device based on structured marking and hybrid coding, and solves the technical problem that the compression rate is obviously low due to an existing log compression method. The method comprises the following steps: acquiring an original log message, and preprocessing the original log message by adopting a predefined separator set and two types of regular expressions to generate a dynamic tag sequence and a static tag sequence; classifying the dynamic label sequence, and outputting a plurality of structured labels and a plurality of unstructured labels; based on the plurality of structured markers, generating a refined skeleton and a simplified sub-marker matrix; generating a dictionary file and a binary coded data file according to the static mark sequence, the plurality of unstructured marks, the refined skeleton and the simplified sub-mark matrix; and compressing the dictionary file and the binary coded data file based on a compression algorithm to generate a complete compressed log file.

A signal transmission method, including: transmitting, by a transmitting end, a frame structure signal; where the frame structure signal includes one or more of: a preamble sequence, a delimiter, a data sequence, control information, or a terminator.