373 results about "Encoding (memory)" patented technology

The invention discloses an intelligent optimization method based on lightweight language training data, which comprises the following steps of: constructing a self-attention mechanism by using a Transform architecture, giving an embedding matrix of an input sequence, n being the sequence length, d being the embedding dimension, representing Query, Key and Value matrixes, and controlling the product magnitude by using a scaling factor; a low-rank adapter is added beside an original weight matrix, a parameter update quantity is decomposed into a product of two small matrixes, and the original weight matrix is a sum of two low-rank matrixes introduced by LoRA. According to the method, an end-to-end personalized dialogue memory system is constructed based on a MiniMind framework, dynamic internalization and accurate recall of user habit information are realized on the premise that a local vector knowledge base does not need to be constructed through organic integration of a supervision fine tuning strategy and a LoRA technology, a dialogue memory coding mechanism is designed, and the memory efficiency is improved. User interaction data is directly mapped into an implicit memory unit of a model parameter space, a lightweight memory trigger-retrieval protocol is developed, key features are extracted through dialogue context, and long-term memory response is activated.

The invention provides a self-adaptive recommendation method based on dynamic strategy optimization, and aims to solve the problems of memory bank update lag, retrieval strategy lag and insufficient long-tail article coverage of an existing recommendation system. A time sequence behavior coding module, a dynamic memory storage bank, a strategy control module and a heterogeneous fusion module are designed; and real-time optimized personalized recommendation is realized. Specifically, a time sequence behavior coding module is used for generating a user state vector with time decay, a dynamic memory storage library automatically updates historical records based on a mixed scoring mechanism, and a strategy control module outputs a learnable retrieval number, a weight coefficient and a fusion parameter. The heterogeneous fusion module realizes cross-channel feature enhancement through a dual-channel attention mechanism; according to the method, the problems of preference drift and long-tail recommendation are effectively solved, meanwhile, the online updating efficiency is improved, and more accurate and diversified recommendation results are provided for users.

A system and method for persistent cognitive computation with temporally synchronized multimodal processing implements a geometric approach to artificial intelligence through typed latent entities within a dynamic manifold substrate. The system maintains a latent manifold incorporating heterogeneous data modalities where local curvature reflects semantic density and typed entities are stratified according to structural properties. Temporal synchronization coordinates asynchronous multimodal data streams through generation of temporal alignment fields within the manifold that preserve semantic coherence across modal boundaries. Type-aware geometric operations enforce operation legality based on entity type and local manifold geometry, enabling structured recombination, compression, and traversal while preventing semantic distortion. The system executes synchronized manifold reorganization during idle periods through coordinated optimization operations including perturbation analysis and topological surgery. This architecture enables persistent memory through geometric encoding where frequently accessed concepts develop high-curvature regions and cognitive patterns emerge from usage-based manifold evolution.

The invention provides a large language model long-term memory method based on human cognition inspiration, which comprises the following steps of: calculating semantic similarity distribution of historical interaction text vectors according to a sliding window, and calculating local information entropy of the window; determining an event boundary based on the local information entropy difference of the adjacent windows; taking each discrete event as the memory of the model, and performing partition management on the memory; when the event memory partition is full, the memory event with the low retention rate is transferred to a long-term memory area; when the interactive content relates to historical information, retrieving related historical events in the event memory partition by using a contextualized memory retrieval method; and the large language model generates content for the user in combination with the current context and the retrieved related historical events. According to the method, memory coding and storage, multi-level dynamic memory management and event-level situational memory retrieval methods based on the event cutting theory are adopted, and therefore the problem that an existing large language model long-term memory method lacks dynamic memory and situational memory is solved.

The invention discloses a heterogeneous intelligent computing power optimization management scheduling system for accelerating a large model reasoning task, and relates to the technical field of computing power optimization management scheduling. The video memory fragmentation problem in a long sequence scene is converted into a controllable block migration task, and the performance bottleneck of a traditional video memory exchange mechanism is broken through; based on an operator-level scheduling strategy of a hardware capability fingerprint database, position coding and other compute-intensive tasks are accurately matched with vector instruction set hardware, and resource mismatch loss caused by black-box scheduling is eliminated; an expert selection process is reconstructed by an integer routing and counting sorting algorithm, near-lossless reasoning is realized at a limited node of an instruction set, and the potential value of an old computing power pool is activated.

The invention provides a multi-modal explicit memory system and device, a storage medium and a program product, and relates to the technical field of multi-modal data retrieval. The multi-modal explicit memory system comprises a multi-modal coding module used for converting multi-modal data such as text, visual and auditory data into vectorized multi-modal features; the unified memory representation module is used for realizing cross-modal alignment and constructing a multi-modal layer explicit memory bank; the self-adaptive rarefaction module is used for pruning or quantifying the multi-modal features; the hierarchical retrieval and fusion module is used for performing hierarchical retrieval and cross-modal fusion in the memory bank; and the cross-modal reasoning and integration module is used for integrating hierarchical retrieval results by using a large language model to obtain a reasoning result of comprehensive multi-modal information. According to the method, by processing text, image and audio information, a reasoning result integrating visual clues, auditory features and text contexts is output, and the data processing efficiency and the multi-modal correlation degree are greatly improved.

The invention belongs to the technical field of dialogue generation, and relates to a digital intelligent carrier pigeon WeChat intelligent dialogue generation method based on deep learning. Dialogue data are obtained, and semantic anomaly detection is carried out through a regular expression and a BERT model in combination with a public corpus; organizing dialogue data in a mode of constructing a tree structure and introducing a three-dimensional timestamp; for emotion information of emoticons, text and visual features of expressions are combined through a hybrid encoder, a dynamic attention mechanism is adopted, weighting and memory length adjustment are carried out according to importance of historical statements, after user portrait features are introduced, user features and dialogue codes are fused, and therefore, the emotion information of the expressions is obtained. In the generation stage, through a Transform-based model and a Beam Search algorithm, a diversity penalty term is introduced in the generation process, and generation parameters are dynamically adjusted according to a user portrait, so that the diversity and security of generated dialogues are ensured, the precision and coherence of a dialogue generation model are improved, and the technical problems of context coherence and personalized generation are effectively solved.

The invention discloses a multi-intersection traffic signal cooperative control method driven by a cross attention neural network, and the method employs a local cooperative Transform architecture, integrates a decision converter and a shared memory mechanism, and achieves the efficient modeling of a space-time dependence relation of a multi-intersection traffic state. The method comprises the following steps: firstly, through a memory head module, extracting a hidden state of each agent in a sequence modeling process, and updating global shared memory for supporting information interaction and strategy collaboration among multiple agents; and then, a cross attention module is adopted to carry out cross calculation on the local representation and the shared memory of each agent, so that dynamic perception and efficient modeling of the global state of the traffic system are realized. A backbone network of the model is based on Transform, and the understanding ability of time and space traffic characteristics is enhanced through position coding, self-attention and cross attention mechanisms. In the fine tuning stage, only the inserted Adapter module and the output layer are subjected to parameter updating.

This specification discloses systems and methods for enhancing the efficiency of transformer models during inference and training by precomputing and storing in memory a significant portion of operations in the first transformer layer. The stored precomputed outputs are retrieved from memory during runtime, reducing computational complexity and memory bandwidth requirements. This approach results in decreased latency, increased throughput, and lower cost-per-token. The disclosed techniques are particularly advantageous for transformer models that incorporate positional encodings within the attention mechanism, such as Rotary Position Embedding (RoPE) and other relative position encoding schemes. The method of offline precomputing involves calculating the outputs of the eliminated operations and components for each of the original vocab_size embedding-vectors, where vocab_size is the size of the embedding vocabulary. One embodiment of the invention removes the feedforward network and the attention query, key, and value projections from the first transformer layer of the encoder and the decoder stacks.

The invention relates to the technical field of complex equipment fault identification processing, in particular to a two-way decoupling and gated memory fused borescope image damage detection method, which is characterized in that a two-way decoupling and gated memory fused borescope image damage detection model is established, and training is performed only by adopting a normal image without a label; establishment of the two-way decoupling and gated memory fused borescope image damage detection model comprises feature decoupling, feature fusion and feature reconstruction, and in the feature decoupling stage, double-trunk encoders are adopted to serve as an effective information encoding branch and a redundant information encoding branch respectively; in the feature fusion stage, an adaptive gating and memory guiding feature fusion module is arranged, a structure perception reconstruction decoder is established in the feature reconstruction stage, fused representation features are sent to the structure perception reconstruction decoder for image reconstruction, and the structure perception reconstruction decoder adopts a joint optimization loss function.

The invention discloses a method and system for generating an EBT scene of a pilot based on a text and flight data, and the method comprises the steps: extracting threat error items in the operation of the pilot from a multi-source text through employing a scene perception word frequency-inverse document frequency method, and generating text analysis; a method of combining time feature attention, convolutional self-encoding and a long short-term memory network is utilized to comprehensively analyze flight data of daily routes and simulator training, dynamic features and potential risk factors in pilot operation are extracted, and flight data analysis is generated; in combination with text data analysis, flight data analysis and a scene element library, training scene elements are generated by adopting a hierarchical rule structure condition generative adversarial network method, and a teacher performs screening and combination to generate a personalized training scene. Through multi-source data fusion and data-driven analysis, a pilot personalized training scene is generated, the pertinence and effectiveness of training are improved, the use of training resources is optimized, and the overall flight safety and training quality are improved.

The invention discloses a large-scale video access and AI reasoning enhancement system and method, belongs to the technical field of video processing, and aims to solve the technical problem of how to realize large-scale video stream efficient access, resource elastic scheduling and abnormity self-healing in a complex environment. Comprising a resource dynamic scheduling module, a decoding and reasoning control module, a resolution dynamic processing module, a multi-stage shared memory transmission module, an exception self-healing and fault-tolerant module and a task parallel execution module, and resource allocation is optimized and calculated by dynamically binding a CPU core and GPU hardware unit isolation; the resolution is dynamically adjusted based on the scene algorithm precision requirement, and invalid calculation is reduced; a stream pushing and frame rate decoding strategy is controlled by using a Redis mark, and memory occupation is reduced by combining long and short queues; transmission coding and decoding are reduced by adopting a shared memory, and the cross-process interaction efficiency is improved; and task self-healing is realized through dual anomaly detection and process-level heartbeat monitoring.

The invention relates to an online action detection method based on multi-stage memory mapping. The method comprises the following specific steps: S1, feature extraction: extracting frame-level features from a video stream by using a pre-training model; s2, memory division: dividing the extracted features into long-term memory and short-term memory according to time; s3, multi-stage mapping memory encoding: adopting a multi-stage mapping encoder for long-term memory, including segmented compression and global compression branches, compressing and extracting key information, and inhibiting irrelevant backgrounds; s4, cyclic decoding and updating: dynamically updating the short-term memory by adopting a cyclic decoder, and generating pre-judgment information of future actions; s5, model training and optimization: improving a loss function through design, optimizing the fusion effect of local features and global dependence in the model, and improving the overall detection performance; and S6, on-line action detection: detecting actions in real time based on the memory features updated by cyclic decoding, and evaluating performance according to actual action labels. According to the invention, the accuracy and robustness of action detection are improved.

The invention provides a multi-modal semantic fusion image and text relevance dynamic analysis method and system, and belongs to the technical field of multi-modal data processing. The method comprises the steps of image and text data preprocessing, feature extraction, fusion semantic vector generation through a bidirectional cross attention mechanism, dynamic relevance score calculation through a time sequence attention long-short-term memory network and combined loss function end-to-end training. According to the method, accurate alignment of image and text features can be realized through a bidirectional cross attention mechanism, the cross-modal matching accuracy is improved, the dynamic correlation analysis capability is enhanced by using time sequence modeling, and the problems of insufficient feature coding suitability and limited time sequence modeling capability in the prior art are solved.

A computer-implemented method of training an encoder neural network of an autoencoder, comprising: receiving a data stream at the autoencoder, the autoencoder comprising an encoder neural network, a decoder neural network, a first memory layer, and a second memory layer; and incrementally training the encoder neural network. The incremental training comprises: performing an encoding process on the input data by the encoder neural network to obtain a latent representation of the input data; processing the encoded input data and encoded input data stored in the first memory layer from previous iterations of the training steps to create a memory representation; performing a decoding process on the latent representation; processing the decoded input data and the updated memory representation to refine the updated memory representation; and outputting the refined memory representation to the encoder neural network for use in a next training step.

A computer-implemented method includes receiving enrollment audio from a user comprising a wake word to be enrolled for the device, preprocessing the enrollment audio to obtain a vector representation along at least a feature dimension and a temporal dimension, inputting the extracted vector representation to a trained encoding model to generate an embedding representation of the enrollment audio, wherein the encoding model includes a plurality of mixing blocks, and wherein the feature dimension and the temporal dimension of an output of a first layer of each mixing block are flipped for inputting to a second layer of the mixing block, and storing the generated embedding representation in a memory for use in detecting input of the enrolled wake word.

The invention provides an examination answer code similarity intelligent comparison and analysis method and system, and relates to the technical field of educational informationization, and the method comprises the steps: adaptively determining an optimal instrumentation position, collecting an execution path sequence and a memory access mode, and constructing a dynamic behavior feature vector; extracting static structure features and fusing the static structure features with the dynamic features; constructing a similarity measurement model by adopting a feature coding network and an adversarial discrimination network comprising three sub-networks; constructing a multi-level adversarial sample library based on a heuristic rule for adversarial training; and finally identifying and positioning the suspected plagiarism code snippets. According to the method, various plagiarism deformation strategies can be effectively identified, and the accuracy of code plagiarism detection is improved.

The invention relates to a video processing method applied to a processor of computer equipment. The computer equipment further comprises an acquisition unit, a memory unit, a blocking unit and a coding unit; the memory unit comprises a pre-allocated cache space; the method comprises the following steps: under the condition that an acquisition unit circularly fills acquired source video data into a cache space in a row filling manner, receiving a row interruption instruction which is triggered and generated after the acquisition unit finishes filling the cache space; in response to the row interrupt instruction, updating a first cache address of the cache space to a blocking unit; and after the blocking unit receives the data reading request sent by the coding unit and judges that the data reading request is released based on the first cache address and a second cache address carried by the data reading request, reading the source video data from the cache space based on the first cache address, and coding the read source video data through the coding unit. By adopting the method, the memory occupation and the coding delay can be reduced.

The invention discloses a man-machine interaction method based on an education robot and a system for intelligently generating a psychological counseling strategy based on interaction records, and constructs a progressive interaction path of tool use-emotional interaction-trust deepening by integrating high-frequency interaction scenes such as learning tutoring and home-school interaction. The system collects multi-modal interaction data through an entity and a software education robot, constructs a trust-intimacy two-dimensional evaluation model (T = 0.6 F1 + 0.4 E, I = 0.5 F2 + 0.5 E), and automatically generates a differentiated psychological counseling scheme based on a Becker T-type model and a four-quadrant strategy matching algorithm. The innovation points comprise a triple authorization privacy protection mechanism (block chain evidence storage and dynamic anonymous ID generation), a multi-modal sentiment analysis engine (a bidirectional coded representation model (BERT), a long short-term memory network (LSTM) and an FACS), and a rule engine and XGBoost mixed strategy generation architecture, and the whole process intelligence from interaction and data analysis to precise psychological counseling strategy generation is realized.

A three-dimensional memory array comprising a plurality of NAND strings. Each NAND string is configured to store a storage data having multiple bits and receive a searching input having multiple bits. Each bit of the storage data and the searching input is of a bit value “0”, a bit value “1”, a wildcard bit or an invalid bit. At least one bit of the storage data is configured as data bit(s), at least bit of the searching input is configured as search bit(s). All of the data bit(s) and the search bit(s) are of bit value “0” or bit value “1”. When the position of the data bit(s) in the storage data overlaps with the position of the search bit(s) in the searching input, the NAND string that stores the storage data is turned off; otherwise, the NAND string that stores the storage data generates an output current.

One or more systems, devices, computer program products and / or computer-implemented methods of use provided herein relate to caching key-value vectors for fixed prefixes according to a caching policy. A system can comprise a memory that can store computer-executable components. The system can further comprise a processor that can execute the computer-executable components stored in the memory, wherein the computer-executable components can comprise an accessing component that can access a request comprising a fixed prefix and variable data. The system can further comprise a storage component that can selectively store in a cache, one or more key-value vectors generated via processing of the fixed prefix by a large language model (LLM), based on a temporal moving average of the fixed prefix being greater than a first defined threshold, according to a smart encoding policy.

Disclosed is an operation device. The operation device includes a memory storing at least one instruction; and a processor configured to execute the at least one instruction, and the processor, by executing the at least one instruction, may perform encoding or decoding for an approximate homomorphic ciphertext using a predetermined matrix having only a half of an element of a matrix corresponding to a canonical embedding function.

The present invention discloses a calculation method, a calculation system and a storage medium for an attention mechanism. The calculation method includes a forward propagation stage and a backward propagation stage; in the forward propagation stage, operators for QKV mapping, updating KV cache and rotary position encoding are fused, and the internal calculation process of the fused operator is adjusted to reduce the time overhead of memory access; in the backward propagation stage, the calculation order and the memory access order are adjusted to improve the efficiency of the backward propagation process. By optimizing the forward propagation and backward propagation processes of attention calculation, and respectively adopting the strategies of operator fusion and calculation process rearrangement, this method reduces the number of memory accesses and the amount of memory access in the calculation, and improves the training and inference performance of the large language model by accelerating the attention calculation process in the large language model.

The invention relates to the technical field of intelligent medicine recommendation, and provides a medicine recommendation method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the time sequence coding processing of the current treatment information of a patient, and generating a semantic vector of the current treatment information; performing multi-message propagation processing on the heterogeneous medical graph based on a graph convolutional neural network to determine knowledge memory vectors of various medical entities, and determining knowledge vectors of the current doctor seeing information based on the knowledge memory vectors; determining fusion information according to the semantic vector and the knowledge vector; and inputting the fusion information into a drug recommendation model, carrying out probability calculation processing that new drugs are used and probability calculation processing that historical drugs are reserved and used on the fusion information, and based on the determined newly-added use probability of each drug, the reserved use probability of each historical drug and an adjacent matrix of drug interaction, carrying out drug recommendation. And determining the drug combination recommended to the patient. The safety of medicine combination is improved, and the accuracy of medicine recommendation is effectively improved.

An example nonvolatile memory device includes page buffer circuits, compression engines, local clock controllers, a data input / output (I / O) circuit, and a control circuit. Each compression engines is connected with a respective page buffer circuit through respective local data lines. The control circuit controls each compression engine to perform an encoding operation based on receiving soft decision data from target cache latches corresponding to an output address, based on compressing the received soft decision data, and based on overwriting the compressed soft decision data in the target cache latches based on an input address, The control circuit controls one or more page buffer circuits among the plurality of page buffer circuits to perform an output operation based on outputting the compressed soft decision data through the data I / O circuit, the output operation performed in parallel with the encoding operation or independently from the encoding operation.

An apparatus for generating text from an image may comprise: a memory configured to store at least one instruction; and a processor configured to execute the at least one instruction, wherein the processor is further configured to generate encoding information for an image based on the image and extract text information related to content of the image based on a degree of association with the encoding information.

The invention discloses a three-dimensional notation coding method and system based on spatio-temporal data fusion, and belongs to the technical field of data fusion, and the method comprises the steps: collecting geographic coordinates and environment voiceprints through Beidou, GPS positioning and COMSOL acoustic modeling, and constructing a sound-space correlation model; through OpenPose and MEMS sensors, limb motions, vocal organ motions and foot stamping intensity parameters are quantified, digital conversion of body memory is completed, and a three-dimensional music score visualization framework is constructed through AR and VR systems; the AR system uses the scanning mark as an interaction entrance, body movement guidance of the Shaanbei folk song and a stage movement design visual interface are matched through a space positioning technology, and dynamic association of a performer and a virtual scene is matched; the VR system generates personalized teaching feedback based on the motion capture data, and optimizes a learning path through real-time data analysis; and the virtual human model inputs action parameters of a three-dimensional notation method to realize automatic performance of non-peoples and folk songs.

A system and method for an adaptive network architecture utilizing dynamically-encoded agents. The system processes data through a base graph layer of interconnected computational nodes, a telemetry layer for real-time monitoring, and one or more agent layers composed of dynamically-encoded agents. These agents optimize encoding strategies, generate new agents, and prune inefficient agents based on network performance objectives. A telemetry layer continuously tracks network operations using adaptive kernel functions and topology-aware distance metrics. The system may dynamically adjust network structure and resource allocation, maintaining efficient operations through encoding optimization. By leveraging short-term and long-term memory systems, the system adapts over time, improving learning retention and responsiveness. Error detection and recovery mechanisms ensure network stability during agent generation and pruning. This approach enables real-time network adaptation, optimizing performance and efficiency across multiple layers while maintaining system resilience and stability.

The invention discloses a storage and calculation integrated array convolution acceleration device and method based on sparse coding, and belongs to the field of artificial intelligence chip design and digital signal processing. The device comprises an unpacking module, a packing module, a calculation reasoning module, a weight configuration module and a state control module. The unpacking module checks and decodes the received data packet, and distributes control information and data content to the weight configuration module or the calculation reasoning module; in a weight configuration mode, the weight configuration module converts an unpacking result into a parallel format, and controls the storage and calculation integrated array to be written into a sparse convolution kernel; in a reasoning mode, the calculation reasoning module decodes sparse excitation and drives the photoelectric storage and calculation integrated unit array to perform convolution calculation, and outputs a calculation result to the packaging module; and the packaging module packages the calculation result and the checksum packet header information and outputs the packaged calculation result and checksum packet header information to the outside. Through combination of a modular architecture and a sparse coding mode, the calculation efficiency is improved, and the input data volume is reduced at the same time.

A system and method for implementing persistent cognitive computation through geometric representation of thought in a dynamic latent manifold. The system encodes inputs into a curved space characterized by time-evolving metric tensors, compression pressure fields derived from Ricci curvature, and goal potential fields that shape attention flow. Cognition occurs through geodesic traversal of this manifold, with attention following paths that minimize cognitive action while balancing semantic density and goal relevance. A Cognitive Dynamics Engine maintains manifold geometry, computing optimal trajectories and managing thought bundle operations including consolidation, expansion, and higher-order abstraction. During idle periods, autonomous dreaming processes reorganize the manifold through perturbation, recombination, and topological surgery. This architecture enables persistent memory through geometric encoding, where frequently accessed concepts develop high-curvature regions and cognitive shortcuts emerge from usage patterns, transforming artificial intelligence from stateless computation to structured motion through shaped memory space.